title: Chirped amplitude mode in photo-excited superconductors

abstract: We show that the amplitude mode in superconductors exhibits chirped oscillations under resonant excitation and that the chirping velocity increases as we approach the critical excitation strength. The chirped amplitude mode enables us to determine the local modification of the effective potential even when the system is in a long-lived pre-thermal state. We then show that this chirped amplitude mode is an experimentally observable quantity since the photo-induced (super)-current in pump-probe experiments serves as an efficient proxy for the dynamics of the order parameter, including the chirped dynamics. Our result is based on the attractive Hubbard model using dynamical mean-field theory within the symmetry-broken state after a resonant excitation across the superconducting gap. Since the collective response takes place on emergently long timescales, we extend the hierarchical low-rank compression method for nonequilibrium Green's functions to symmetry-broken states and show that it serves as an efficient representation despite long-lived memory kernels.


title: The Hidden Attention of Mamba Models

abstract: The Mamba layer offers an efficient selective state space model (SSM) that is highly effective in modeling multiple domains, including NLP, long-range sequence processing, and computer vision. Selective SSMs are viewed as dual models, in which one trains in parallel on the entire sequence via an IO-aware parallel scan, and deploys in an autoregressive manner. We add a third view and show that such models can be viewed as attention-driven models. This new perspective enables us to empirically and theoretically compare the underlying mechanisms to that of the self-attention layers in transformers and allows us to peer inside the inner workings of the Mamba model with explainability methods. Our code is publicly available.


title: Electroweak Phase Transition in Singlet Extensions of The Standard Model with Dimension-Six Operators

abstract: The significance of the electroweak phase transition is undeniable, and although initially it was believed that it was second-order, it is now believed that it is a first-order transition. However, it is not a strong first-order phase transition in the context of the Standard Model and the remedy to this issue is to use the Higgs portal and directly couple the Higgs to a hidden scalar sector. This can result in a strong electroweak phase transition, while the couplings to a hidden scalar are constrained by several phenomenological constraints, such as the sphaleron rate criterion and the branching ratio of the Higgs to invisible channels. In this work, we consider the standard singlet extensions of the Standard Model, including dimension-six non-renormalizable operators that couple a real singlet scalar field with the Higgs doublet. As a result, we examine the effects of those Higgs-singlet couplings on the electroweak phase transition. The effective theory, where the non-renormalizable couplings originate from, is considered to be active beyond 15$\,$TeV. As we show, the Universe experiences a two-step electroweak phase transition, a primary phase transition in the singlet sector at a high temperature, and then a subsequent first-order phase transition from the singlet vacuum to the electroweak vacuum. The singlet's phase transition can either be second-order or first-order, depending on the singlet mass and its couplings to the Higgs. In particular, we show that the dimension-six operator assists in generating a strong electroweak phase transition in regions of the parameter space that were excluded in the previous singlet extensions of the Standard Model. This is further apparent for low singlet masses \(m_S < m_H/2\) which are rarely taken into account in the literature due to the invisible branching ratio of the Higgs boson.


title: On Companion sequences associated with Leonardo quaternions: Applications over finite fields

abstract: In this paper, we introduce a new class of quaternions called Lucas-Leonardo p-quaternions and derive several fundamental properties of these numbers. Furthermore, we investigate some applications related to companion sequences associated with Leonardo quaternions. In particular, we determine Lucas-Leonardo quaternions and Francois quaternions, which are zero divisors and invertible elements in the quaternion algebra over certain finite fields.


title: A Continuous-Time Stochastic Model of the Fiscal Theory of the Price Level and Consistency of Its Critique

abstract: The paper tests the validity of the critique of the fiscal theory of the price level. A stochastic general equilibrium model with continuous time is constructed. An active fiscal policy and a passive monetary policy have been set. Monetary policy manages the interest rate through the Taylor rule. The stochastic default factor in the special form is introduced. A complete definite system of equations is obtained for the detection of equilibrium. It is asserted that the peculiarities of the approach to modeling are of critical importance for verifying the presence of certain hypotheses and formulating conclusions. The results of this work are in support of the fiscal theory of the price level.


title: Never Tell the Trick: Covert Interactive Mixed Reality System for Immersive Storytelling

abstract: This study explores the integration of Ultra-Wideband (UWB) technology into Mixed Reality (MR) Systems for immersive storytelling. Addressing the limitations of existing technologies like Microsoft Kinect and HTC Vive, the research focuses on overcoming challenges in robustness to occlusion, tracking volume, and cost efficiency in props tracking. Utilizing UWB technology, the interactive MR system enhances the scope of performance art by enabling larger tracking areas, more reliable and cheaper multi-prop tracking, and reducing occlusion issues. Preliminary user tests suggest meaningful improvements in immersive experience, promising a new possibility in Extended Reality (XR) theater, performance art and immersive game.


title: Optical spectroscopy of comets using Hanle Echelle Spectrograph (HESP)

abstract: Observing the vibrational/rotational lines in a comet's optical spectrum requires high-resolution spectroscopy, as they are otherwise seen as a blended feature. To achieve this, we have obtained medium and high-resolution (R ($\lambda/\Delta \lambda$) = 30000 and 60000) spectra of several comets, including C/2015 V2 (Johnson), 46P/Wirtanen, 41P/Tuttle-Giacobini-Kres\'ak and 38P/Stephan-Oterma, using the Hanle Echelle Spectrograph (HESP) mounted on the 2-m Himalayan Chandra Telescope (HCT) in India. The spectra effectively cover the wavelength range 3700 - 10,000 {\AA}, allowing us to probe the various vibrational bands and band sequences to identify the rotational lines in the cometary molecular emission. We were also able to separate the cometary Oxygen lines from the telluric lines and analyse the green-to-red (G/R) forbidden oxygen [OI] ratios in a few comets. For comets C/2015 V2, 46P, and 41P, the computed G/R ratios, 0.04$\pm$0.01, 0.04$\pm$0.01, and 0.08$\pm$0.02 respectively, point to H$_2$O being a major source of Oxygen emissions. Notably, in the second fibre pointing at a location 1000 km away from the photocenter of comet 46P, the G/R ratio reduced by more than half the value observed in the first fibre, indicating the effects of quenching within the inner coma. We also measured the NH$_2$ ortho-to-para ratio of comet 46P to be about 3.41$\pm$0.05 and derived an ammonia ratio of 1.21$\pm$0.03 corresponding to a spin temperature of $\sim$26 K. With these, we present the results of the study of four comets from different cometary reservoirs using medium and high-resolution optical spectroscopy, emphasising the capabilities of the instrument for future cometary studies.


title: Optimizing Near Field Computation in the MLFMA Algorithm with Data Redundancy and Performance Modeling on a Single GPU

abstract: The Multilevel Fast Multipole Algorithm (MLFMA) has known applications in scientific modeling in the fields of telecommunications, physics, mechanics, and chemistry. Accelerating calculation of far-field using GPUs and GPU clusters for large-scale problems has been studied for more than a decade. The acceleration of the Near Field Computation (P2P operator) however was less of a concern because it does not face the challenges of distributed processing which does far field. This article proposes a modification of the P2P algorithm and uses performance models to determine its optimality criteria. By modeling the speedup, we found that making threads independence by creating redundancy in the data makes the algorithm for lower dense (higher frequency) problems nearly 13 times faster than non-redundant mode.


title: Nonlinear Behavior of Josephson Traveling Wave Parametric Amplifiers

abstract: Recent advancements in quantum technologies and advanced detection experiments have underscored the pressing need for the detection of exceedingly weak signals within the microwave frequency spectrum. Addressing this challenge, the Josephson Traveling Wave Parametric Amplifier (JTWPA) has been proposed as a cryogenic front-end amplifier capable of approaching the quantum noise limit while providing a relevant bandwidth. This research is centered on a comprehensive numerical investigation of the JTWPA, without resorting to simplifications regarding the nonlinearity of the essential components. Specifically, this study focuses on a thorough examination of the system, characterized by coupled nonlinear differential equations representing all components of the device. Proper input and output signals at the device's boundaries are considered. The analysis of the output signals undergoing the parametric amplification process involves a detailed exploration of phase-space dynamics and Fourier spectral analysis of the output voltage. This study is conducted while considering the parameters ruling the response of the device under pump and signal excitations. In addition to the expected signal amplification, the findings reveal that the nonlinear nature of the system can give rise to unforeseen phenomena, depending on the system's operational conditions, which include: the generation of pump tone harmonics, modulation of the signal gain, and incommensurate frequency generation-effects that are not easily accommodated by simplistic linearized approaches


title: APISR: Anime Production Inspired Real-World Anime Super-Resolution

abstract: While real-world anime super-resolution (SR) has gained increasing attention in the SR community, existing methods still adopt techniques from the photorealistic domain. In this paper, we analyze the anime production workflow and rethink how to use characteristics of it for the sake of the real-world anime SR. First, we argue that video networks and datasets are not necessary for anime SR due to the repetition use of hand-drawing frames. Instead, we propose an anime image collection pipeline by choosing the least compressed and the most informative frames from the video sources. Based on this pipeline, we introduce the Anime Production-oriented Image (API) dataset. In addition, we identify two anime-specific challenges of distorted and faint hand-drawn lines and unwanted color artifacts. We address the first issue by introducing a prediction-oriented compression module in the image degradation model and a pseudo-ground truth preparation with enhanced hand-drawn lines. In addition, we introduce the balanced twin perceptual loss combining both anime and photorealistic high-level features to mitigate unwanted color artifacts and increase visual clarity. We evaluate our method through extensive experiments on the public benchmark, showing our method outperforms state-of-the-art anime dataset-trained approaches.


title: SCHEMA: State CHangEs MAtter for Procedure Planning in Instructional Videos

abstract: We study the problem of procedure planning in instructional videos, which aims to make a goal-oriented sequence of action steps given partial visual state observations. The motivation of this problem is to learn a structured and plannable state and action space. Recent works succeeded in sequence modeling of steps with only sequence-level annotations accessible during training, which overlooked the roles of states in the procedures. In this work, we point out that State CHangEs MAtter (SCHEMA) for procedure planning in instructional videos. We aim to establish a more structured state space by investigating the causal relations between steps and states in procedures. Specifically, we explicitly represent each step as state changes and track the state changes in procedures. For step representation, we leveraged the commonsense knowledge in large language models (LLMs) to describe the state changes of steps via our designed chain-of-thought prompting. For state change tracking, we align visual state observations with language state descriptions via cross-modal contrastive learning, and explicitly model the intermediate states of the procedure using LLM-generated state descriptions. Experiments on CrossTask, COIN, and NIV benchmark datasets demonstrate that our proposed SCHEMA model achieves state-of-the-art performance and obtains explainable visualizations.


title: Can Poverty Be Reduced by Acting on Discrimination? An Agent-based Model for Policy Making

abstract: In the last decades, there has been a deceleration in the rates of poverty reduction, suggesting that traditional redistributive approaches to poverty mitigation could be losing effectiveness, and alternative insights to advance the number one UN Sustainable Development Goal are required. The criminalization of poor people has been denounced by several NGOs, and an increasing number of voices suggest that discrimination against the poor (a phenomenon known as \emph{aporophobia}) could be an impediment to mitigating poverty. In this paper, we present the novel Aporophobia Agent-Based Model (AABM) to provide evidence of the correlation between aporophobia and poverty computationally. We present our use case built with real-world demographic data and poverty-mitigation public policies (either enforced or under parliamentary discussion) for the city of Barcelona. We classify policies as discriminatory or non-discriminatory against the poor, with the support of specialized NGOs, and we observe the results in the AABM in terms of the impact on wealth inequality. The simulation provides evidence of the relationship between aporophobia and the increase of wealth inequality levels, paving the way for a new generation of poverty reduction policies that act on discrimination and tackle poverty as a societal problem (not only a problem of the poor).


title: Measuring Technological Convergence in Encryption Technologies with Proximity Indices: A Text Mining and Bibliometric Analysis using OpenAlex

abstract: Identifying technological convergence among emerging technologies in cybersecurity is crucial for advancing science and fostering innovation. Unlike previous studies focusing on the binary relationship between a paper and the concept it attributes to technology, our approach utilizes attribution scores to enhance the relationships between research papers, combining keywords, citation rates, and collaboration status with specific technological concepts. The proposed method integrates text mining and bibliometric analyses to formulate and predict technological proximity indices for encryption technologies using the "OpenAlex" catalog. Our case study findings highlight a significant convergence between blockchain and public-key cryptography, evidenced by the increasing proximity indices. These results offer valuable strategic insights for those contemplating investments in these domains.


title: Optimal Sizing of Hybrid Renewable Energy Based Microgrid System

abstract: With the decline of fossil fuel reserves and the escalating global average temperature, the quest for environmentally friendly and renewable energy sources has gained significant momentum. Focus has turned to wind and photovoltaic energy, but their variable inputs necessitate energy storage for reliable power. Economic viability of hybrid renewable power requires meticulous optimization of generating units to ensure uninterrupted and efficient energy production. This paper presents an optimal sizing approach for a Wind-Photovoltaic-Biogas-Battery system using a single objective optimization (SOO) method. A comprehensive comparative analysis is conducted, evaluating the convergence speed and objective mean (for minimization) of seven metaheuristic optimizers: Particle Swarm Optimization (PSO), Aquila Optimizer (AO), Pelican Optimization Algorithm (POA), Dandelion Optimizing Algorithm (DOA), Gazelle Optimization Algorithm (GOA), Zebra Optimization Algorithm (ZOA), and Osprey Optimization Algorithm (OOA). The results demonstrate that the Pelican Optimization Algorithm (POA) outperforms other existing algorithms, exhibiting faster convergence and lower objective mean.


title: Grain Boundary Segregation Models for High-Entropy Alloys: Theoretical Formulation and Derived Analytical Expressions to Elucidate High-Entropy Grain Boundaries

abstract: Grain boundary (GB) segregation models are derived for multi-principal element and high-entropy alloys (MPEAs and HEAs). Differing from classical models where one component is taken as solvent and others are considered solutes, these models are referenced to the bulk composition to enable improved treatments of MPEAs and HEAs with no principal components. An ideal solution model is first formulated and solved to obtain analytical expressions that predict GB segregation and GB energy in MPEAs and HEAs. A regular solution model is further derived. The GB composition calculated using the simple analytical expression derived in this study and data from the Materials Project agree well with a prior sphosipcated atomistic simulation for NbMoTaW. The simplicity of the derived analytical expressions makes them useful for not only conveniently predicting GB segregation trends in HEAs, but also analyzing nascent interfacial phenomena in composionally complex GBs. As an application example, the derived models are used to further formulate a set of useful equations to elucidate an emergent concept of high-entropy grain boundaries (HEGBs).


title: On $e^*$-$\theta$-$D$-sets and Related Topics

abstract: This paper aims to study the notion of $e^*\text{-}\theta$-open \cite{Ozkoc1} sets and to investigate new properties of this notion. Also, we define a new type of set, called $e^*\text{-}\theta\text{-}D$-set, via the notion of $e^*\text{-}\theta$-open set. Moreover, we introduce some new separation axioms by utilizing $e^*\text{-}\theta\text{-}D$-sets. We obtain many results related to these new notions. In addition, the notions of $e^*\text{-}\theta\text{-}$kernel and slightly $e^*\text{-}\theta\text{-}R_0$ space are defined. Some characterizations regarding these new notions have been obtained. Furthermore, we have given many examples concerning the mentioned notions. Finally, we not only put forward the definition of $e^*\text{-}R_1$ space but also obtained some of its characterizations.


title: Towards Provable Log Density Policy Gradient

abstract: Policy gradient methods are a vital ingredient behind the success of modern reinforcement learning. Modern policy gradient methods, although successful, introduce a residual error in gradient estimation. In this work, we argue that this residual term is significant and correcting for it could potentially improve sample-complexity of reinforcement learning methods. To that end, we propose log density gradient to estimate the policy gradient, which corrects for this residual error term. Log density gradient method computes policy gradient by utilising the state-action discounted distributional formulation. We first present the equations needed to exactly find the log density gradient for a tabular Markov Decision Processes (MDPs). For more complex environments, we propose a temporal difference (TD) method that approximates log density gradient by utilizing backward on-policy samples. Since backward sampling from a Markov chain is highly restrictive we also propose a min-max optimization that can approximate log density gradient using just on-policy samples. We also prove uniqueness, and convergence under linear function approximation, for this min-max optimization. Finally, we show that the sample complexity of our min-max optimization to be of the order of $m^{-1/2}$, where $m$ is the number of on-policy samples. We also demonstrate a proof-of-concept for our log density gradient method on gridworld environment, and observe that our method is able to improve upon the classical policy gradient method by a clear margin, thus indicating a promising novel direction to develop reinforcement learning algorithms that require fewer samples.


title: A Unified Model Selection Technique for Spectral Clustering Based Motion Segmentation

abstract: Motion segmentation is a fundamental problem in computer vision and is crucial in various applications such as robotics, autonomous driving and action recognition. Recently, spectral clustering based methods have shown impressive results on motion segmentation in dynamic environments. These methods perform spectral clustering on motion affinity matrices to cluster objects or point trajectories in the scene into different motion groups. However, existing methods often need the number of motions present in the scene to be known, which significantly reduces their practicality. In this paper, we propose a unified model selection technique to automatically infer the number of motion groups for spectral clustering based motion segmentation methods by combining different existing model selection techniques together. We evaluate our method on the KT3DMoSeg dataset and achieve competitve results comparing to the baseline where the number of clusters is given as ground truth information.


title: Respiratory motion forecasting with online learning of recurrent neural networks for safety enhancement in externally guided radiotherapy

abstract: In lung radiotherapy, infrared cameras can record the location of reflective objects on the chest to infer the position of the tumor moving due to breathing, but treatment system latencies hinder radiation beam precision. Real-time recurrent learning (RTRL), is a potential solution as it can learn patterns within non-stationary respiratory data but has high complexity. This study assesses the capabilities of resource-efficient online RNN algorithms, namely unbiased online recurrent optimization (UORO), sparse-1 step approximation (SnAp-1), and decoupled neural interfaces (DNI) to forecast respiratory motion during radiotherapy treatment accurately. We use time series containing the 3D position of external markers on the chest of healthy subjects. We propose efficient implementations for SnAp-1 and DNI based on compression of the influence and immediate Jacobian matrices and an accurate update of the linear coefficients used in credit assignment estimation, respectively. The original sampling frequency was 10Hz; we performed resampling at 3.33Hz and 30Hz. We use UORO, SnAp-1, and DNI to forecast each marker's 3D position with horizons (the time interval in advance for which the prediction is made) h<=2.1s and compare them with RTRL, least mean squares, and linear regression. RNNs trained online achieved similar or better accuracy than most previous works using larger training databases and deep learning, even though we used only the first minute of each sequence to predict motion within that exact sequence. SnAp-1 had the lowest normalized root mean square errors (nRMSE) averaged over the horizon values considered, equal to 0.335 and 0.157, at 3.33Hz and 10.0Hz, respectively. Similarly, UORO had the highest accuracy at 30Hz, with an nRMSE of 0.0897. DNI's inference time, equal to 6.8ms per time step at 30Hz (Intel Core i7-13700 CPU), was the lowest among the RNN methods examined.


title: Inverted-circuit zero-noise extrapolation for quantum gate error mitigation

abstract: A common approach to deal with gate errors in modern quantum-computing hardware is zero-noise extrapolation. By artificially amplifying errors and extrapolating the expectation values obtained with different error strengths towards the zero-error (zero-noise) limit, the technique aims at rectifying errors in noisy quantum computing systems. For an accurate extrapolation, it is essential to know the exact factors of the noise amplification. In this article, we propose a simple method for estimating the strength of errors occurring in a quantum circuit and demonstrate improved extrapolation results. The method determines the error strength for a circuit by appending to it the inverted circuit and measuring the probability of the initial state. The estimation of error strengths is easy to implement for arbitrary circuits and does not require a previous characterisation of noise properties. We compare this method with the conventional zero-noise extrapolation method and show that the novel method leads to a more accurate calculation of expectation values. Our method proves to be particularly effective on current hardware, showcasing its suitability for near-term quantum computing applications.


title: A "User Experience 3.0 (UX 3.0)" Paradigm Framework: User Experience Design for Human-Centered AI Systems

abstract: The human-centered artificial intelligence (HCAI) design approach, the user-centered design (UCD) version in the intelligence era, has been promoted to address potential negative issues caused by AI technology; user experience design (UXD) is specifically called out to facilitate the design and development of human-centered AI systems. Over the last three decades, user experience (UX) practice can be divided into three stages in terms of technology platform, user needs, design philosophy, ecosystem, scope, focus, and methodology of UX practice. UX practice is moving towards the intelligence era. Still, the existing UX paradigm mainly aims at non-intelligent systems and lacks a systematic approach to address UX for designing and developing human-centered AI products and systems. The intelligence era has put forward new demands on the UX paradigm. This paper proposes a "UX 3.0" paradigm framework and the corresponding UX methodology for UX practice in the intelligence era. The "UX 3.0" paradigm framework includes four categories of emerging experiences in the intelligence era: ecosystem-based experience, innovation-enabled experience, AI-enabled experience, and human-AI interaction-based experience, each compelling us to enhance current UX practice in terms of design philosophy, scope, focus, and methodology. We believe that the "UX 3.0" paradigm helps enhance existing UX practice and provides methodological support for the research and applications of UX in developing human-centered AI systems. Finally, this paper looks forward to future work implementing the "UX 3.0" paradigm.


title: Graph-based variant discovery reveals novel dynamics in the human microbiome

abstract: Sequence differences between the strains of bacteria comprising host-associated and environmental microbiota may play a role in community assembly and influence the resilience of microbial communities to disturbances. Tools for characterizing strain-level variation within microbial communities, however, are limited in scope, focusing on just single nucleotide polymorphisms, or relying on reference-based analyses that miss complex functional and structural variants. Here, we demonstrate the power of assembly graph analysis to detect and characterize structural variants in almost 1,000 metagenomes generated as part of the Human Microbiome Project. We identify over nine million variants comprising insertion/deletion events, repeat copy-number changes, and mobile elements such as plasmids. We highlight some of the potential functional roles of these genomic changes. Our analysis revealed striking differences in the rate of variation across body sites, highlighting niche-specific mechanisms of bacterial adaptation. The structural variants we detect also include potentially novel prophage integration events, highlighting the potential use of graph-based analyses for phage discovery.


title: The Grasp Loop Signature: A Topological Representation for Manipulation Planning with Ropes and Cables

abstract: Robotic manipulation of deformable, one-dimensional objects (DOOs) like ropes or cables has important potential applications in manufacturing, agriculture, and surgery. In such environments, the task may involve threading through or avoiding becoming tangled with objects like racks or frames. Grasping with multiple grippers can create closed loops between the robot and DOO, and If an obstacle lies within this loop, it may be impossible to reach the goal. However, prior work has only considered the topology of the DOO in isolation, ignoring the arms that are manipulating it. Searching over possible grasps to accomplish the task without considering such topological information is very inefficient, as many grasps will not lead to progress on the task due to topological constraints. Therefore, we propose a grasp loop signature which categorizes the topology of these grasp loops and show how it can be used to guide planning. We perform experiments in simulation on two DOO manipulation tasks to show that using the signature is faster and succeeds more often than methods that rely on local geometry or finite-horizon planning. Finally, we demonstrate using the signature in the real world to manipulate a cable in a scene with obstacles using a dual-arm robot.


title: Discrete Newtonian dynamics with Nos\'{e}-Hoover thermostats

abstract: Almost all Molecular Dynamics (MD) simulations are discrete dynamics with Newton's algorithm first published in 1687, and much later by L. Verlet in 1967. Discrete Newtonian dynamics has the same qualities as Newton's classical analytic dynamics. Verlet also published a first-order expression for the instant temperature which is inaccurate but presumably used in most MD simulations. One of the motivations for the present article is to correct this unnecessary inaccuracy in $NVT$ MD dynamics. Another motivation is to derive simple algorithms for the Nos\'{e}-Hoover $NVT$ dynamics (NH) with the correct temperature constraint. The simulations with NH discrete Newtonian dynamics show that the NH works excellent for a wide range of the response time $\tau$ of the NH thermostat, but NH simulations favor a choice of a short response time, even shorter than the discrete-time increment $\delta t$ used in MD, to avoid large oscillations of the temperature.


title: Object classification with Convolutional Neural Networks: from KiDS to Euclid

abstract: Large-scale imaging surveys have grown about 1000 times faster than the number of astronomers in the last 3 decades. Using Artificial Intelligence instead of astronomer's brains for interpretative tasks allows astronomers to keep up with the data. We give a progress report on using Convolutional Neural Networks (CNNs) to classify three classes of rare objects (galaxy mergers, strong gravitational lenses and asteroids) in the Kilo-Degree Survey (KiDS) and the Euclid Survey.


title: Real-time optimization of thermoelectric coolers' performance based on energy and exergy analysis

abstract: New strategy is presented to optimize the performance of Thermoelectric (TE) coolers. This approach breaks optimizing TE coolers free from traditional methods of controlling temperature or engineering materials and the structural properties of the junctions. We introduced a dimensionless figure, {\gamma}, that shows the ratio of the unavailable cooling capacity to the available cooling capacity. This parameter relates the TE coolers' coefficient of performance (COP) to the COP of the reversible cycle (second law of thermodynamics efficiency) for a given electrical current. The theoretical description of the model is presented, and it is shown that controlling {\gamma} during the TE performance minimizes entropy generation and energy loss, which leads to the maximum pumped heat. We validated this model against a designed TE cooler. In this cooler, contrary to conventional TE coolers, where the temperature of the cold space is generally controlled at a specific temperature, and the performance of the cooler overlooked, the entropy generation and heat loss are engineered, and the electrical current is tuned to minimize {\gamma} by the controller so that the TE cooler works near to its optimum performance at any time.


title: Partial Federated Learning

abstract: Federated Learning (FL) is a popular algorithm to train machine learning models on user data constrained to edge devices (for example, mobile phones) due to privacy concerns. Typically, FL is trained with the assumption that no part of the user data can be egressed from the edge. However, in many production settings, specific data-modalities/meta-data are limited to be on device while others are not. For example, in commercial SLU systems, it is typically desired to prevent transmission of biometric signals (such as audio recordings of the input prompt) to the cloud, but egress of locally (i.e. on the edge device) transcribed text to the cloud may be possible. In this work, we propose a new algorithm called Partial Federated Learning (PartialFL), where a machine learning model is trained using data where a subset of data modalities or their intermediate representations can be made available to the server. We further restrict our model training by preventing the egress of data labels to the cloud for better privacy, and instead use a contrastive learning based model objective. We evaluate our approach on two different multi-modal datasets and show promising results with our proposed approach.


title: Towards Comprehensive Vietnamese Retrieval-Augmented Generation and Large Language Models

abstract: This paper presents our contributions towards advancing the state of Vietnamese language understanding and generation through the development and dissemination of open datasets and pre-trained models for Vietnamese Retrieval-Augmented Generation (RAG) and Large Language Models (LLMs).


title: On fresh sets in iterations of Prikry type forcing notions

abstract: We examine the existence (and mostly non-existence) of fresh sets in commonly used iterations of Prikry type forcing notions. Results of [4] are generalized. As an application, a question of a referee of [9] is answered. In addition stationary sets preservation is addressed.


title: A Predictive Model for Catalytic Methane Pyrolysis

abstract: Methane pyrolysis provides a scalable alternative to conventional hydrogen production methods, avoiding greenhouse gas emissions. However, high operating temperatures limit economic feasibility on an industrial scale. A major scientific goal is, therefore, to find a catalyst material that lowers operating temperatures, making methane pyrolysis economically viable. In this work, we derive a model that provides a qualitative comparison of possible catalyst materials. The model is based on calculations of adsorption energies using density functional theory. Thirty different elements were considered. Adsorption energies of intermediate molecules in the methane pyrolysis reaction correlate linearly with the adsorption energy of carbon. Moreover, the adsorption energy increases in magnitude with decreasing group number in the $d$-block of the periodic table. For a temperature range between 600 and 1200 K and a normalized partial pressure range for $\mathrm{H_2}$ between $10^{-1}$ and $10^{-5}$, a total of eighteen different materials were found to be optimal catalysts at least once. This indicates that catalyst selection and reactor operating conditions should be well-matched. The present work establishes the foundation for future large-scale studies of surfaces, alloy compositions, and material classes using machine learning algorithms.


title: Spectrum AUC Difference (SAUCD): Human-aligned 3D Shape Evaluation

abstract: Existing 3D mesh shape evaluation metrics mainly focus on the overall shape but are usually less sensitive to local details. This makes them inconsistent with human evaluation, as human perception cares about both overall and detailed shape. In this paper, we propose an analytic metric named Spectrum Area Under the Curve Difference (SAUCD) that demonstrates better consistency with human evaluation. To compare the difference between two shapes, we first transform the 3D mesh to the spectrum domain using the discrete Laplace-Beltrami operator and Fourier transform. Then, we calculate the Area Under the Curve (AUC) difference between the two spectrums, so that each frequency band that captures either the overall or detailed shape is equitably considered. Taking human sensitivity across frequency bands into account, we further extend our metric by learning suitable weights for each frequency band which better aligns with human perception. To measure the performance of SAUCD, we build a 3D mesh evaluation dataset called Shape Grading, along with manual annotations from more than 800 subjects. By measuring the correlation between our metric and human evaluation, we demonstrate that SAUCD is well aligned with human evaluation, and outperforms previous 3D mesh metrics.


title: Regularity of the solution to a real Monge--Amp\`ere equation on the boundary of a simplex

abstract: Motivated by conjectures in Mirror Symmetry, we continue the study of the real Monge--Amp\`ere operator on the boundary of a simplex. This can be formulated in terms of optimal transport, and we consider, more generally, the problem of optimal transport between symmetric probability measures on the boundary of a simplex and of the dual simplex. For suitably regular measures, we obtain regularity properties of the transport map, and of its convex potential. To do so, we exploit boundary regularity results for optimal transport maps by Caffarelli, together with the symmetries of the simplex.


title: Machine Learning vs Deep Learning: The Generalization Problem

abstract: The capacity to generalize beyond the range of training data is a pivotal challenge, often synonymous with a model's utility and robustness. This study investigates the comparative abilities of traditional machine learning (ML) models and deep learning (DL) algorithms in terms of extrapolation -- a more challenging aspect of generalization because it requires the model to make inferences about data points that lie outside the domain it has been trained on. We present an empirical analysis where both ML and DL models are trained on an exponentially growing function and then tested on values outside the training domain. The choice of this function allows us to distinctly showcase the divergence in performance when models are required to predict beyond the scope of their training data. Our findings suggest that deep learning models possess inherent capabilities to generalize beyond the training scope, an essential feature for real-world applications where data is often incomplete or extends beyond the observed range. This paper argues for a nuanced understanding of the structural differences between ML and DL models, with an emphasis on the implications for both theoretical research and practical deployment.


title: A Human-Centered Approach for Bootstrapping Causal Graph Creation

abstract: Causal inference, a cornerstone in disciplines such as economics, genomics, and medicine, is increasingly being recognized as fundamental to advancing the field of robotics. In particular, the ability to reason about cause and effect from observational data is crucial for robust generalization in robotic systems. However, the construction of a causal graphical model, a mechanism for representing causal relations, presents an immense challenge. Currently, a nuanced grasp of causal inference, coupled with an understanding of causal relationships, must be manually programmed into a causal graphical model. To address this difficulty, we present initial results towards a human-centered augmented reality framework for creating causal graphical models. Concretely, our system bootstraps the causal discovery process by involving humans in selecting variables, establishing relationships, performing interventions, generating counterfactual explanations, and evaluating the resulting causal graph at every step. We highlight the potential of our framework via a physical robot manipulator on a pick-and-place task.


title: ML4PhySim : Machine Learning for Physical Simulations Challenge (The airfoil design)

abstract: The use of machine learning (ML) techniques to solve complex physical problems has been considered recently as a promising approach. However, the evaluation of such learned physical models remains an important issue for industrial use. The aim of this competition is to encourage the development of new ML techniques to solve physical problems using a unified evaluation framework proposed recently, called Learning Industrial Physical Simulations (LIPS). We propose learning a task representing a well-known physical use case: the airfoil design simulation, using a dataset called AirfRANS. The global score calculated for each submitted solution is based on three main categories of criteria covering different aspects, namely: ML-related, Out-Of-Distribution, and physical compliance criteria. To the best of our knowledge, this is the first competition addressing the use of ML-based surrogate approaches to improve the trade-off computational cost/accuracy of physical simulation.The competition is hosted by the Codabench platform with online training and evaluation of all submitted solutions.


title: Pinched-up periodic KPZ fixed point

abstract: The periodic KPZ fixed point is the conjectural universal limit of the KPZ universality class models on a ring when both the period and time critically tend to infinity. For the case of the periodic narrow wedge initial condition, we consider the conditional distribution when the periodic KPZ fixed point is unusually large at a particular position and time. We prove a conditional limit theorem up to the ``pinch-up" time. When the period is large enough, the result is the same as that for the KPZ fixed point on the line obtained by Liu and Wang in 2022. We identify the regimes in which the result changes and find probabilistic descriptions of the limits.


title: Magnonic $\varphi$ Josephson Junctions and Synchronized Precession

abstract: There has been a growing interest in non-Hermitian physics. One of its main goals is to engineer dissipation and to explore ensuing functionality. In magnonics, the effect of dissipation due to local damping on magnon transport has been explored. However, the effects of non-local damping on the magnonic analog of the Josephson effect remain missing, despite that non-local damping is inevitable and has been playing a central role in magnonics. Here, we uncover theoretically that a surprisingly rich dynamics can emerge in magnetic junctions due to intrinsic non-local damping, using analytical and numerical methods. In particular, under microwave pumping, we show that coherent spin precession in the right and left insulating ferromagnet (FM) of the junction becomes synchronized by non-local damping and thereby a magnonic analog of the $\varphi$ Josephson junction emerges, where $\varphi$ stands here for the relative precession phase of right and left FM in the stationary limit. Remarkably, $\varphi$ decreases monotonically from $ \pi$ to $\pi/2$ as the magnon-magnon interaction, arising from spin anisotropies, increases. Moreover, we also find a magnonic diode effect giving rise to rectification of magnon currents. Our predictions are readily testable with current device and measurement technologies at room temperatures.

categories: cond-mat.mes-hall cond-mat.mtrl-sci cond-mat.quant-gas cond-mat.str-el cond-mat.supr-con


title: Using LLMs for Tabletop Exercises within the Security Domain

abstract: Tabletop exercises are a crucial component of many company's strategy to test and evaluate its preparedness for security incidents in a realistic way. Traditionally led by external firms specializing in cybersecurity, these exercises can be costly, time-consuming, and may not always align precisely with the client's specific needs. Large Language Models (LLMs) like ChatGPT offer a compelling alternative. They enable faster iteration, provide rich and adaptable simulations, and offer infinite patience in handling feedback and recommendations. This approach can enhances the efficiency and relevance of security preparedness exercises.


title: Acceleration of digital memcomputing by jumps

abstract: In this article, we present the potential benefits of incorporating jumps into the dynamics of digital memcomputing machines (DMMs), which have been developed to address complex optimization problems. We illustrate the potential speed improvement of a DMM solver with jumps over an unmodified DMM solver by solving Boolean satisfiability (SAT) problems of different complicatedness. Our findings suggest that jumps can modify scaling exponents and improve solving times by up to 75 %. Interestingly, the advantages of jumps can be seen in cases where the size of the jump is so large that otherwise the continuous dynamics of voltage variables becomes almost binary.


title: Recent Advances, Applications, and Open Challenges in Machine Learning for Health: Reflections from Research Roundtables at ML4H 2023 Symposium

abstract: The third ML4H symposium was held in person on December 10, 2023, in New Orleans, Louisiana, USA. The symposium included research roundtable sessions to foster discussions between participants and senior researchers on timely and relevant topics for the \ac{ML4H} community. Encouraged by the successful virtual roundtables in the previous year, we organized eleven in-person roundtables and four virtual roundtables at ML4H 2022. The organization of the research roundtables at the conference involved 17 Senior Chairs and 19 Junior Chairs across 11 tables. Each roundtable session included invited senior chairs (with substantial experience in the field), junior chairs (responsible for facilitating the discussion), and attendees from diverse backgrounds with interest in the session's topic. Herein we detail the organization process and compile takeaways from these roundtable discussions, including recent advances, applications, and open challenges for each topic. We conclude with a summary and lessons learned across all roundtables. This document serves as a comprehensive review paper, summarizing the recent advancements in machine learning for healthcare as contributed by foremost researchers in the field.


title: VR Research at Fraunhofer IGD, Darmstadt, Germany

abstract: We present a historical outline of the research and developments of Virtual Reality at the Fraunhofer Institute for Computer Graphics (IGD) in Darmstadt, Germany, from 1990 through 2000.


title: Relational to RDF Data Migration by Query Co-Evaluation

abstract: In this paper we define a new algorithm to convert an input relational database to an output set of RDF triples. The algorithm can be used to e.g. load CSV data into a financial OWL ontology such as FIBO. The algorithm takes as input a set of relational conjunctive (select-from-where) queries, one for each input table, from the three column (subject, predicate, object) output RDF schema to the input table's relational schema. The algorithm's output is the only set of RDF triples for which a unique round-trip of the input data under the relational queries exists. The output may contain blank nodes, is unique up to unique isomorphism, and can be obtained using elementary formal methods (equational theorem proving and term model construction specifically). We also describe how (generalized) homomorphisms between graphs can be used to write such relational conjunctive (select-from-where) queries, which, due to the lack of structure in the three-column RDF schema, tend to be large in practice. We demonstrate examples of both the algorithm and mapping language on the FIBO financial ontology.


title: TreeTracker Join: Turning the Tide When a Tuple Fails to Join

abstract: Many important query processing methods proactively use semijoins or semijoin-like filters to delete dangling tuples, i.e., tuples that do not appear in the final query result. Semijoin methods can achieve formal optimality but have high upfront cost in practice. Filter methods reduce the cost but lose the optimality guarantee. We propose a new join algorithm, TreeTracker Join ($\mathsf{TTJ}$), that achieves the data complexity optimality for acyclic conjunctive queries (ACQs) without semijoins or semijoin-like filters. $\mathsf{TTJ}$ leverages join failure events, where a tuple from one of the relations of a binary join operator fails to match any tuples from the other relation. $\mathsf{TTJ}$ starts join evaluation immediately and when join fails, $\mathsf{TTJ}$ identifies the tuple as dangling and prevents it from further consideration in the execution of the query. The design of $\mathsf{TTJ}$ exploits the connection between query evaluation and constraint satisfaction problem (CSP) by treating a join tree of an ACQ as a constraint network and the query evaluation as a CSP search problem. $\mathsf{TTJ}$ is a direct extension of a CSP algorithm, TreeTracker, that embodies two search techniques backjumping and no-good. We establish that join tree and plan can be constructed from each other in order to incorporate the search techniques into physical operators in the iterator form. We compare $\mathsf{TTJ}$ with hash-join, a classic semijoin method: Yannakakis's algorithm, and two contemporary filter methods: Predicate Transfer and Lookahead Information Passing. Favorable empirical results are developed using standard query benchmarks: JOB, TPC-H, and SSB.


title: SynCode: LLM Generation with Grammar Augmentation

abstract: LLMs are widely used in complex AI applications. These applications underscore the need for LLM outputs to adhere to a specific format, for their integration with other components in the systems. Typically the format rules e.g., for data serialization formats such as JSON, YAML, or Code in Programming Language are expressed as context-free grammar (CFG). Due to the hallucinations and unreliability of LLMs, instructing LLMs to adhere to specified syntax becomes an increasingly important challenge. We present SynCode, a novel framework for efficient and general syntactical decoding with LLMs, to address this challenge. SynCode leverages the CFG of a formal language, utilizing an offline-constructed efficient lookup table called DFA mask store based on the discrete finite automaton (DFA) of the language grammar terminals. We demonstrate SynCode's soundness and completeness given the CFG of the formal language, presenting its ability to retain syntactically valid tokens while rejecting invalid ones. SynCode seamlessly integrates with any language defined by CFG, as evidenced by experiments focusing on generating JSON, Python, and Go outputs. Our experiments evaluating the effectiveness of SynCode for JSON generation demonstrate that SynCode eliminates all syntax errors and significantly outperforms state-of-the-art baselines. Furthermore, our results underscore how SynCode significantly reduces 96.07% of syntax errors in generated Python and Go code, showcasing its substantial impact on enhancing syntactical precision in LLM generation. Our code is available at https://github.com/uiuc-focal-lab/syncode


title: Critical windows: non-asymptotic theory for feature emergence in diffusion models

abstract: We develop theory to understand an intriguing property of diffusion models for image generation that we term critical windows. Empirically, it has been observed that there are narrow time intervals in sampling during which particular features of the final image emerge, e.g. the image class or background color (Ho et al., 2020b; Meng et al., 2022; Choi et al., 2022; Raya & Ambrogioni, 2023; Georgiev et al., 2023; Sclocchi et al., 2024; Biroli et al., 2024). While this is advantageous for interpretability as it implies one can localize properties of the generation to a small segment of the trajectory, it seems at odds with the continuous nature of the diffusion. We propose a formal framework for studying these windows and show that for data coming from a mixture of strongly log-concave densities, these windows can be provably bounded in terms of certain measures of inter- and intra-group separation. We also instantiate these bounds for concrete examples like well-conditioned Gaussian mixtures. Finally, we use our bounds to give a rigorous interpretation of diffusion models as hierarchical samplers that progressively "decide" output features over a discrete sequence of times. We validate our bounds with synthetic experiments. Additionally, preliminary experiments on Stable Diffusion suggest critical windows may serve as a useful tool for diagnosing fairness and privacy violations in real-world diffusion models.


title: Crystal Structure and Magnetism of Actinide Oxides: A Review

abstract: In actinide systems, the 5f electrons experience a uniquely delicate balance of effects and interactions having similar energy scales, which are often difficult to properly disentangle. This interplay of factors such as the dual nature of 5f-states, strong electronic correlations, and strong spin-orbit coupling results in electronically unusual and intriguing behavior such as multi-k antiferromagnetic ordering, multipolar ordering, mott-physics, mixed valence configurations, and more. Despite the inherent allure of their exotic properties, the exploratory science of even the more basic, binary systems like the actinide oxides has been limited due to their toxicity, radioactivity, and reactivity. In this article, we provide an overview of the available synthesis techniques for selected binary actinide oxides, including the actinide dioxides, sesquioxides, and a selection of higher oxides. For these oxides, we also review and evaluate the current state of knowledge of their crystal structures and magnetic properties. In many aspects, substantial knowledge gaps exist in the current body of research on actinide oxides related to understanding their electronic ground states. Bridging these gaps is vital for improving not only a fundamental understanding of these systems but also of future nuclear technologies. To this end, we note the experimental techniques and necessary future investigations which may aid in better elucidating the nature of these fascinating systems.


title: Application of Neural Ordinary Differential Equations for Tokamak Plasma Dynamics Analysis

abstract: In the quest for controlled thermonuclear fusion, tokamaks present complex challenges in understanding burning plasma dynamics. This study introduces a multi-region multi-timescale transport model, employing Neural Ordinary Differential Equations (Neural ODEs) to simulate the intricate energy transfer processes within tokamaks. Our methodology leverages Neural ODEs for the numerical derivation of diffusivity parameters from DIII-D tokamak experimental data, enabling the precise modeling of energy interactions between electrons and ions across various regions, including the core, edge, and scrape-off layer. These regions are conceptualized as distinct nodes, capturing the critical timescales of radiation and transport processes essential for efficient tokamak operation. Validation against DIII-D plasmas under various auxiliary heating conditions demonstrates the model's effectiveness, ultimately shedding light on ways to enhance tokamak performance with deep learning.


title: Sample Efficient Myopic Exploration Through Multitask Reinforcement Learning with Diverse Tasks

abstract: Multitask Reinforcement Learning (MTRL) approaches have gained increasing attention for its wide applications in many important Reinforcement Learning (RL) tasks. However, while recent advancements in MTRL theory have focused on the improved statistical efficiency by assuming a shared structure across tasks, exploration--a crucial aspect of RL--has been largely overlooked. This paper addresses this gap by showing that when an agent is trained on a sufficiently diverse set of tasks, a generic policy-sharing algorithm with myopic exploration design like $\epsilon$-greedy that are inefficient in general can be sample-efficient for MTRL. To the best of our knowledge, this is the first theoretical demonstration of the "exploration benefits" of MTRL. It may also shed light on the enigmatic success of the wide applications of myopic exploration in practice. To validate the role of diversity, we conduct experiments on synthetic robotic control environments, where the diverse task set aligns with the task selection by automatic curriculum learning, which is empirically shown to improve sample-efficiency.


title: Self-limiting stacks of curvature-frustrated colloidal plates: Roles of intra-particle versus inter-particle deformations

abstract: In geometrically frustrated assemblies local inter-subunit misfits propagate to intra-assembly strain gradients, giving rise to anomalous self-limiting assembly thermodynamics. Here, we use theory and coarse-grained simulation to study a recently developed class of ``curvamer'' particles, flexible shell-like particles that exhibit self-limiting assembly due to the build up of curvature deformation in cohesive stacks. To address a generic, yet poorly understood aspect of frustrated assembly, we introduce a model of curvamer assembly that incorporates both {\it intra-particle} shape deformation as well as compliance of {\it inter-particle} cohesive gaps, an effect we can attribute to a {\it finite range of attraction} between particles. We show that the ratio of intra-particle (bending elasticity) to inter-particle stiffness not only controls the regimes of self-limitation but also the nature of frustration propagation through curvamer stacks. We find a transition from uniformly-bound, curvature-focusing stacks at small size to gap-opened, uniformly curved stacks at large size is controlled by a dimensionless measure of inter- versus intra-curvamer stiffness. The finite range of inter-particle attraction determines range of cohesion in stacks are self-limiting, a prediction which is in strong agreement with numerical studies of our coarse-grained colloidal model. These predictions provide critical guidance for experimental realizations of frustrated particle systems designed to exhibit self-limitation at especially large multi-particle scales.


title: Multi-level Product Category Prediction through Text Classification

abstract: This article investigates applying advanced machine learning models, specifically LSTM and BERT, for text classification to predict multiple categories in the retail sector. The study demonstrates how applying data augmentation techniques and the focal loss function can significantly enhance accuracy in classifying products into multiple categories using a robust Brazilian retail dataset. The LSTM model, enriched with Brazilian word embedding, and BERT, known for its effectiveness in understanding complex contexts, were adapted and optimized for this specific task. The results showed that the BERT model, with an F1 Macro Score of up to $99\%$ for segments, $96\%$ for categories and subcategories and $93\%$ for name products, outperformed LSTM in more detailed categories. However, LSTM also achieved high performance, especially after applying data augmentation and focal loss techniques. These results underscore the effectiveness of NLP techniques in retail and highlight the importance of the careful selection of modelling and preprocessing strategies. This work contributes significantly to the field of NLP in retail, providing valuable insights for future research and practical applications.


title: Theoretical Insights for Diffusion Guidance: A Case Study for Gaussian Mixture Models

abstract: Diffusion models benefit from instillation of task-specific information into the score function to steer the sample generation towards desired properties. Such information is coined as guidance. For example, in text-to-image synthesis, text input is encoded as guidance to generate semantically aligned images. Proper guidance inputs are closely tied to the performance of diffusion models. A common observation is that strong guidance promotes a tight alignment to the task-specific information, while reducing the diversity of the generated samples. In this paper, we provide the first theoretical study towards understanding the influence of guidance on diffusion models in the context of Gaussian mixture models. Under mild conditions, we prove that incorporating diffusion guidance not only boosts classification confidence but also diminishes distribution diversity, leading to a reduction in the differential entropy of the output distribution. Our analysis covers the widely adopted sampling schemes including DDPM and DDIM, and leverages comparison inequalities for differential equations as well as the Fokker-Planck equation that characterizes the evolution of probability density function, which may be of independent theoretical interest.


title: Effect of Feathers on Drag in Plunge Diving Birds

abstract: This study explores the impact of feathers on the hydrodynamic drag experienced by diving birds, which is critical to their foraging efficiency and survival. Employing a novel experimental approach, we analyzed the kinematics of both feathered and non-feathered projectiles during their transition from air to water using high-speed imaging and an onboard accelerometer. The drag coefficients were determined through two methods: a direct calculation from the acceleration data and a theoretical approach fitted to the observed velocity profiles. Our results indicate that feathers significantly increase the drag force during water entry, with feathered projectiles exhibiting approximately double the drag coefficient of their smooth counterparts. These findings provide new insights into the role of avian feather morphology in diving mechanics and have potential implications for the design of bio-inspired aquatic vehicles in engineering. The study also discusses the biological implications of increased drag due to feathers and suggests that factors such as body shape might play a more critical role in the diving capabilities of birds than previously understood.


title: AIO2: Online Correction of Object Labels for Deep Learning with Incomplete Annotation in Remote Sensing Image Segmentation

abstract: While the volume of remote sensing data is increasing daily, deep learning in Earth Observation faces lack of accurate annotations for supervised optimization. Crowdsourcing projects such as OpenStreetMap distribute the annotation load to their community. However, such annotation inevitably generates noise due to insufficient control of the label quality, lack of annotators, frequent changes of the Earth's surface as a result of natural disasters and urban development, among many other factors. We present Adaptively trIggered Online Object-wise correction (AIO2) to address annotation noise induced by incomplete label sets. AIO2 features an Adaptive Correction Trigger (ACT) module that avoids label correction when the model training under- or overfits, and an Online Object-wise Correction (O2C) methodology that employs spatial information for automated label modification. AIO2 utilizes a mean teacher model to enhance training robustness with noisy labels to both stabilize the training accuracy curve for fitting in ACT and provide pseudo labels for correction in O2C. Moreover, O2C is implemented online without the need to store updated labels every training epoch. We validate our approach on two building footprint segmentation datasets with different spatial resolutions. Experimental results with varying degrees of building label noise demonstrate the robustness of AIO2. Source code will be available at https://github.com/zhu-xlab/AIO2.git.


title: Blue and Green-Mode Energy-Efficient Chemiresistive Sensor Array Realized by Rapid Ensemble Learning

abstract: The rapid advancement of Internet of Things (IoT) necessitates the development of optimized Chemiresistive Sensor (CRS) arrays that are both energy-efficient and capable. This study introduces a novel optimization strategy that employs a rapid ensemble learning-based model committee approach to achieve these goals. Utilizing machine learning models such as Elastic Net Regression, Random Forests, and XGBoost, among others, the strategy identifies the most impactful sensors in a CRS array for accurate classification: A weighted voting mechanism is introduced to aggregate the models' opinions in sensor selection, thereby setting up wo distinct working modes, termed "Blue" and "Green". The Blue mode operates with all sensors for maximum detection capability, while the Green mode selectively activates only key sensors, significantly reducing energy consumption without compromising detection accuracy. The strategy is validated through theoretical calculations and Monte Carlo simulations, demonstrating its effectiveness and accuracy. The proposed optimization strategy not only elevates the detection capability of CRS arrays but also brings it closer to theoretical limits, promising significant implications for the development of low-cost, easily fabricable next-generation IoT sensor terminals.


title: You Need to Pay Better Attention: Rethinking the Mathematics of Attention Mechanism

abstract: Scaled Dot Product Attention (SDPA) is the backbone of many modern deep-learning models. It is so versatile that it has been used in natural language, vision, and multi-modal domains with very little change compared to its original formulation. This paper discusses why the current formulation is inefficient by delving into the mathematical details of the attention mechanism. We propose three improvements to mitigate these inefficiencies, thereby, introducing three enhanced attention mechanisms: Optimised, Efficient, and Super Attention. Optimised and Efficient Attention have one and two matrix multiplications fewer per head, respectively, and 25% and 50% fewer parameters, respectively, than standard SDPA, but perform similarly to standard SDPA in both vision and natural language tasks. They can be used in all applications where SDPA is used while offering smaller model sizes and faster training and inference without noticeable loss in performance. Super Attention introduces a new linear transformation on the values, transforming them from the left. It outperforms standard SPDA on vision and natural language tasks by up to 17% while having one fewer matrix multiplication per head and 25% fewer parameters than standard SDPA. Consequently, it is also faster than standard SDPA. Super Attention is ideal in applications where the attention layer's context length is fixed, such as Vision Transformers. In addition to providing mathematical reasoning, we evaluate the presented attention mechanisms on several datasets including MNIST, CIFAR100, ImageNet, IMDB Movie Reviews, and Amazon Reviews datasets, as well as combined Europarl and Anki English-Spanish datasets for neural machine translation.


title: OccFusion: Multi-Sensor Fusion Framework for 3D Semantic Occupancy Prediction

abstract: A comprehensive understanding of 3D scenes is crucial in autonomous vehicles (AVs), and recent models for 3D semantic occupancy prediction have successfully addressed the challenge of describing real-world objects with varied shapes and classes. However, existing methods for 3D occupancy prediction heavily rely on surround-view camera images, making them susceptible to changes in lighting and weather conditions. This paper introduces OccFusion, a novel sensor fusion framework for predicting 3D occupancy. By integrating features from additional sensors, such as lidar and surround view radars, our framework enhances the accuracy and robustness of occupancy prediction, resulting in top-tier performance on the nuScenes benchmark. Furthermore, extensive experiments conducted on the nuScenes and semanticKITTI dataset, including challenging night and rainy scenarios, confirm the superior performance of our sensor fusion strategy across various perception ranges. The code for this framework will be made available at https://github.com/DanielMing123/OccFusion.


title: Radiation Process in Relativistic MHD Waves: the Case of Circularly Polarized Alfv\'{e}n Wave

abstract: Turbulence in highly magnetized plasma can be relativistic and induce an electric field comparable to the background magnetic field. Such a strong electric field can affect the emission process of non-thermal electrons. As the first step toward elucidating the emission process in relativistic turbulence, we study the radiation process of electrons in relativistic circularly polarized Alfv\'{e}n waves. While the induced electric field boosts the average energy of low-energy electrons with a Larmor radius smaller than the wavelength, the emissivity for such electrons is suppressed because of the elongated gyro-motion trajectory. The trajectory of high-energy electrons is shaken by the small-scale electric field, which enhances the emissivity. Since the effective Lorentz factor of $E\times B$ drift is $\simeq\sqrt{2}$ in the circularly polarized Alfv\'{e}n waves, the deviation from the standard synchrotron emission is not so prominent. However, a power-law energy injection in the waves can produce a concave photon spectrum, which is similar to the GeV extra component seen in GRB spectra. If the turbulence electric field is responsible for the GeV extra component in GRBs, the estimates of the typical electron energy and magnetic field should be largely altered.


title: TweetInfo: An Interactive System to Mitigate Online Harm

abstract: The increase in active users on social networking sites (SNSs) has also observed an increase in harmful content on social media sites. Harmful content is described as an inappropriate activity to harm or deceive an individual or a group of users. Alongside existing methods to detect misinformation and hate speech, users still need to be well-informed about the harmfulness of the content on SNSs. This study proposes a user-interactive system TweetInfo for mitigating the consumption of harmful content by providing metainformation about the posts. It focuses on two types of harmful content: hate speech and misinformation. TweetInfo provides insights into tweets by doing content analysis. Based on previous research, we have selected a list of metainformation. We offer the option to filter content based on metainformation Bot, Hate Speech, Misinformation, Verified Account, Sentiment, Tweet Category, Language. The proposed user interface allows customising the user's timeline to mitigate harmful content. This study present the demo version of the propose user interface of TweetInfo.


title: Neural Network Assisted Lifting Steps For Improved Fully Scalable Lossy Image Compression in JPEG 2000

abstract: This work proposes to augment the lifting steps of the conventional wavelet transform with additional neural network assisted lifting steps. These additional steps reduce residual redundancy (notably aliasing information) amongst the wavelet subbands, and also improve the visual quality of reconstructed images at reduced resolutions. The proposed approach involves two steps, a high-to-low step followed by a low-to-high step. The high-to-low step suppresses aliasing in the low-pass band by using the detail bands at the same resolution, while the low-to-high step aims to further remove redundancy from detail bands, so as to achieve higher energy compaction. The proposed two lifting steps are trained in an end-to-end fashion; we employ a backward annealing approach to overcome the non-differentiability of the quantization and cost functions during back-propagation. Importantly, the networks employed in this paper are compact and with limited non-linearities, allowing a fully scalable system; one pair of trained network parameters are applied for all levels of decomposition and for all bit-rates of interest. By employing the proposed approach within the JPEG 2000 image coding standard, our method can achieve up to 17.4% average BD bit-rate saving over a wide range of bit-rates, while retaining quality and resolution scalability features of JPEG 2000.


title: "I just hated it and I want my money back": Data-driven Understanding of Mobile VPN Service Switching Preferences in The Wild

abstract: Virtual Private Networks (VPNs) are a crucial Privacy-Enhancing Technology (PET) leveraged by millions of users and catered by multiple VPN providers worldwide; thus, understanding the user preferences for the choice of VPN apps should be of importance and interest to the security community. To that end, prior studies looked into the usage, awareness and adoption of VPN users and the perceptions of providers. However, no study so far has looked into the user preferences and underlying reasons for switching among VPN providers and identified features that presumably enhance users' VPN experience. This work aims to bridge this gap and shed light on the underlying factors that drive existing users when they switch from one VPN to another. In this work, we analyzed over 1.3 million reviews from 20 leading VPN apps, identifying 1,305 explicit mentions and intents to switch. Our NLP-based analysis unveiled distinct clusters of factors motivating users to switch. An examination of 376 blogs from six popular VPN recommendation sites revealed biases in the content, and we found ignorance towards user preferences. We conclude by identifying the key implications of our work for different stakeholders. The data and code for this work is available at https://github.com/Mainack/switch-vpn-datacode-sec24.


title: Recommendations for Government Development and Use of Advanced Automated Systems to Make Decisions about Individuals

abstract: Contestability -- the ability to effectively challenge a decision -- is critical to the implementation of fairness. In the context of governmental decision making about individuals, contestability is often constitutionally required as an element of due process; specific procedures may be required by state or federal law relevant to a particular program. In addition, contestability can be a valuable way to discover systemic errors, contributing to ongoing assessments and system improvement. On January 24-25, 2024, with support from the National Science Foundation and the William and Flora Hewlett Foundation, we convened a diverse group of government officials, representatives of leading technology companies, technology and policy experts from academia and the non-profit sector, advocates, and stakeholders for a workshop on advanced automated decision making, contestability, and the law. Informed by the workshop's rich and wide-ranging discussion, we offer these recommendations. A full report summarizing the discussion is in preparation.


title: On the maximum principle for general linear elliptic equations

abstract: We consider maximum principles and related estimates for linear second order elliptic partial differential operators in n-dimensional Euclidean space, which improve previous results, with H-J Kuo, through sharp Lp dependence on the drift coefficient b. As in our previous work, the ellipticity is determined through the principal coefficient matrix A lying in sub-cones of the positive cone, which are dual cones of the Garding k-cones. Our main results are maximum principles for bounded domains, which extend those of Aleksandrov in the case k = n, together with extensions to unbounded domains, depending on appropriate integral norms of A, and corresponding local maximum principles. We also consider applications to local estimates in the uniformly elliptic case, including extensions of the Krylov-Safonov Holder and Harnack estimates.


title: Dagger $n$-categories

abstract: We present a coherent definition of dagger $(\infty,n)$-category in terms of equivariance data trivialized on parts of the category. Our main example is the bordism higher category $\mathbf{Bord}_{n}^X$. This allows us to define a reflection-positive topological quantum field theory to be a higher dagger functor from $\mathbf{Bord}_{n}^X$ to some target higher dagger category $\mathcal{C}$. Our definitions have a tunable parameter: a group $G$ acting on the $(\infty,1)$-category $\mathbf{Cat}_{(\infty,n)}$ of $(\infty,n)$-categories. Different choices for $G$ accommodate different flavours of higher dagger structure; the universal choice is $G = \operatorname{Aut}(\mathbf{Cat}_{(\infty,n)}) = (\mathbb{Z}/2\mathbb{Z})^n$, which implements dagger involutions on all levels of morphisms. The Stratified Cobordism Hypothesis suggests that there should be a map $\mathrm{PL}(n) \to \operatorname{Aut}(\mathbf{AdjCat}_{(\infty,n)})$, where $\mathrm{PL}(n)$ is the group of piecewise-linear automorphisms of $\mathbb{R}^n$ and $\mathbf{AdjCat}_{(\infty,n)}$ the $(\infty,1)$-category of $(\infty,n)$-categories with all adjoints; we conjecture more strongly that $\operatorname{Aut}(\mathbf{AdjCat}_{(\infty,n)}) \cong \mathrm{PL}(n)$. Based on this conjecture we propose a notion of dagger $(\infty,n)$-category with unitary duality or $\mathrm{PL}(n)$-dagger category. We outline how to construct a $\mathrm{PL}(n)$-dagger structure on the fully-extended bordism $(\infty,n)$-category $\mathbf{Bord}_n^X$ for any stable tangential structure $X$; our outline restricts to a rigorous construction of a coherent dagger structure on the unextended bordism $(\infty,1)$-category $\mathbf{Bord}_{n,n-1}^X$. The article is a report on the results of a workshop held in Summer 2023, and is intended as a sketch of the big picture and an invitation for more thorough development.


title: Towards Memory-Efficient Traffic Policing in Time-Sensitive Networking

abstract: Time-Sensitive Networking (TSN) is an emerging real-time Ethernet technology that provides deterministic communication for time-critical traffic. At its core, TSN relies on Time-Aware Shaper (TAS) for pre-allocating frames in specific time intervals and Per-Stream Filtering and Policing (PSFP) for mitigating the fatal disturbance of unavoidable frame drift. However, as first identified in this work, PSFP incurs heavy memory consumption during policing, hindering normal switching functionalities. This work proposes a lightweight policing design called FooDog, which could facilitate sub-microsecond jitter with ultra-low memory consumption. FooDog employs a period-wise and stream-wise structure to realize the memory-efficient PSFP without loss of determinism. Results using commercial FPGAs in typical aerospace scenarios show that FooDog could keep end-to-end time-sensitive traffic jitter <150 nanoseconds in the presence of abnormal traffic, comparable to typical TSN performance without anomalies. Meanwhile, it consumes merely hundreds of kilobits of memory, reducing >90% of on-chip memory overheads than unoptimized PSFP design.


title: Day-ahead regional solar power forecasting with hierarchical temporal convolutional neural networks using historical power generation and weather data

abstract: Regional solar power forecasting, which involves predicting the total power generation from all rooftop photovoltaic systems in a region holds significant importance for various stakeholders in the energy sector. However, the vast amount of solar power generation and weather time series from geographically dispersed locations that need to be considered in the forecasting process makes accurate regional forecasting challenging. Therefore, previous work has limited the focus to either forecasting a single time series (i.e., aggregated time series) which is the addition of all solar generation time series in a region, disregarding the location-specific weather effects or forecasting solar generation time series of each PV site (i.e., individual time series) independently using location-specific weather data, resulting in a large number of forecasting models. In this work, we propose two deep-learning-based regional forecasting methods that can effectively leverage both types of time series (aggregated and individual) with weather data in a region. We propose two hierarchical temporal convolutional neural network architectures (HTCNN) and two strategies to adapt HTCNNs for regional solar power forecasting. At first, we explore generating a regional forecast using a single HTCNN. Next, we divide the region into multiple sub-regions based on weather information and train separate HTCNNs for each sub-region; the forecasts of each sub-region are then added to generate a regional forecast. The proposed work is evaluated using a large dataset collected over a year from 101 locations across Western Australia to provide a day ahead forecast. We compare our approaches with well-known alternative methods and show that the sub-region HTCNN requires fewer individual networks and achieves a forecast skill score of 40.2% reducing a statistically significant error by 6.5% compared to the best counterpart.


title: A study of Be stars in the time domain. I. Spectral data and polarimetry

abstract: We present the first part of a spectroscopic and polarimetric study on a sample of 58 Be stars that have been measured since 1998. The aim of the study is to understand the timescales of disk variability, formation and dissipation as a function of the properties (mass, luminosity and rotational velocity) of the underlying B star. In this paper we classified the sample based on the presence of emission or absorption of the H$\alpha$ line, and the shape of the peak as single or double peak, as well as noting changes between emission and non-emission states. We find a probability of $\sim 0.75$ percent per year that an object in the sample will undergo such a change. We also present re-derived values of the projected rotational velocities for the sample. When we compare our polarization values with those from the literature, we find that most of the stars do not show a change in the value of the polarization angle, however a small number show significant changes which could be attributed to either disk strength (optical depth) or geometry changes. Finally we show how, by combining the (interstellar corrected) degree of polarization and the projected rotational velocity, we can construct an inclination angle-free parameter that includes the true equatorial velocity. Using this inclination angle-independent parameter we show that the populations of single and double peak stars are indistinguishable, giving further evidence that Be star line profiles are essentially inclination angle driven.


title: Bayesian inference via geometric optics approximation

abstract: Markov chain Monte Carlo (MCMC) simulations have been widely used to generate samples from the complex posterior distribution in Bayesian inferences. However, these simulations often require multiple computations of the forward model in the likelihood function for each drawn sample. This computational burden renders MCMC sampling impractical when the forward model is computationally expensive, such as in the case of partial differential equation models. In this paper, we propose a novel sampling approach called the geometric optics approximation method (GOAM) for Bayesian inverse problems, which entirely circumvents the need for MCMC simulations. Our method is rooted in the problem of reflector shape design, which focuses on constructing a reflecting surface that redirects rays from a source, with a predetermined density, towards a target domain while achieving a desired density distribution. The key idea is to consider the unnormalized Bayesian posterior as the density on the target domain within the optical system and define a geometric optics approximation measure with respect to posterior by a reflecting surface. Consequently, once such a reflecting surface is obtained, we can utilize it to draw an arbitrary number of independent and uncorrelated samples from the posterior measure for Bayesian inverse problems. In theory, we have shown that the geometric optics approximation measure is well-posed. The efficiency and robustness of our proposed sampler, employing the geometric optics approximation method, are demonstrated through several numerical examples provided in this paper.


title: Solar Wind Driven from GONG Magnetograms in the Last Solar Cycle

abstract: In a previous study, Huang et al. (2023) used the Alfven Wave Solar atmosphere Model (AWSoM), one of the widely used solar wind models in the community, driven by ADAPT-GONG magnetograms to simulate the solar wind in the last solar cycle and found that the optimal Poynting flux parameter can be estimated from either the open field area or the average unsigned radial component of the magnetic field in the open field regions. It was also found that the average energy deposition rate (Poynting flux) in the open field regions is approximately constant. In the current study, we expand the previous work by using GONG magnetograms to simulate the solar wind for the same Carrington rotations and determine if the results are similar to the ones obtained with ADAPT-GONG magnetograms. Our results indicate that similar correlations can be obtained from the GONG maps. Moreover, we report that ADAPT-GONG magnetograms can consistently provide better comparisons with 1 AU solar wind observations than GONG magnetograms, based on the best simulations selected by the minimum of the average curve distance for the solar wind speed and density.


title: Generalized pair-wise logit dynamic and its connection to a mean field game: theoretical and computational investigations focusing on resource management

abstract: Logit dynamics are evolution equations that describe transitions to equilibria of actions among many players. We formulate a pair-wise logit dynamic in a continuous action space with a generalized exponential function, which we call a generalized pair-wise logit dynamic, depicted by a new evolution equation nonlocal in space. We prove the well-posedness and approximability of the generalized pair-wise logit dynamic to show that it is computationally implementable. We also show that this dynamic has an explicit connection to a mean field game of a controlled pure-jump process, with which the two different mathematical models can be understood in a unified way. Particularly, we show that the generalized pair-wise logit dynamic is derived as a myopic version of the corresponding mean field game, and that the conditions to guarantee the existence of unique solutions are different from each other. The key in this procedure is to find the objective function to be optimized in the mean field game based on the logit function. The monotonicity of the utility is unnecessary for the generalized pair-wise logit dynamic but crucial for the mean field game. Finally, we present applications of the two approaches to fisheries management problems with collected data.


title: Noise sensitivity and stability on groups

abstract: We discuss finitely generated infinite groups on which natural random walks are noise sensitive in total variation as well as ones on which natural random walks are noise stable in total variation.


title: Improved performance of the Bacon-Shor code with Steane's syndrome extraction method

abstract: We compare Steane's and Shor's syndrome extraction methods on the Bacon-Shor code. We propose a straightforward strategy based on post-selection to prepare the logical $|0\rangle_L$ and $|+\rangle_L$ states of the Bacon-Shor code by using flag-like qubits to verify their constituent Greenberger-Horne-Zeilinger states. We perform stabilizer simulations with a depolarizing Pauli error model and find that Steane's method significantly outperforms Shor's. Not only does Steane's method result in pseudo-thresholds that are about 1 order of magnitude higher than Shor's, but also its advantage increases monotonically as we go from a distance-3 to a distance-9 Bacon-Shor code. The advantage of Steane's method is the greatest in the regime where gate errors dominate over measurement errors. Some of the circuit constructions we propose for Steane's method are not formally fault-tolerant, yet outperform the formally fault-tolerant Shor's protocols for experimentally relevant physical error rates. This suggest that constructing formally fault-tolerant circuits that maintain the full code distance is not strictly necessary to guarantee the usefulness of a quantum error-correcting protocol. Despite relying on post-selection, we find that our methods can be efficient. These protocols would be naturally implementable on a platform with long-range qubit interactions like trapped ions or neutral atoms.


title: Geometry and Stability of Supervised Learning Problems

abstract: We introduce a notion of distance between supervised learning problems, which we call the Risk distance. This optimal-transport-inspired distance facilitates stability results; one can quantify how seriously issues like sampling bias, noise, limited data, and approximations might change a given problem by bounding how much these modifications can move the problem under the Risk distance. With the distance established, we explore the geometry of the resulting space of supervised learning problems, providing explicit geodesics and proving that the set of classification problems is dense in a larger class of problems. We also provide two variants of the Risk distance: one that incorporates specified weights on a problem's predictors, and one that is more sensitive to the contours of a problem's risk landscape.


title: Dimension conservation of harmonic measures in products of hyperbolic spaces

abstract: We show that the harmonic measure on a product of boundaries satisfies dimension conservation for a random walk with non-elementary marginals on a countable group acting on a product of hyperbolic spaces under finite first moment condition.


title: Atropos-k is PSPACE-complete

abstract: Burke and Teng introduced a two-player combinatorial game Atropos based on Sperner's lemma, and showed that deciding whether one has a winning strategy for Atropos is PSPACE-complete. In the original Atropos game, the players must color a node adjacent to the last colored node. Burke and Teng also mentioned a variant Atropos-k in which each move is at most of distance k of the previous move, and asked a question on determining the computational complexity of this variant. In this paper, we answer this question by showing that for any fixed integer k (k>=2), Atropos-k is PSPACE-complete by reduction from True Quantified Boolean Formula (TQBF).


title: PillarGen: Enhancing Radar Point Cloud Density and Quality via Pillar-based Point Generation Network

abstract: In this paper, we present a novel point generation model, referred to as Pillar-based Point Generation Network (PillarGen), which facilitates the transformation of point clouds from one domain into another. PillarGen can produce synthetic point clouds with enhanced density and quality based on the provided input point clouds. The PillarGen model performs the following three steps: 1) pillar encoding, 2) Occupied Pillar Prediction (OPP), and 3) Pillar to Point Generation (PPG). The input point clouds are encoded using a pillar grid structure to generate pillar features. Then, OPP determines the active pillars used for point generation and predicts the center of points and the number of points to be generated for each active pillar. PPG generates the synthetic points for each active pillar based on the information provided by OPP. We evaluate the performance of PillarGen using our proprietary radar dataset, focusing on enhancing the density and quality of short-range radar data using the long-range radar data as supervision. Our experiments demonstrate that PillarGen outperforms traditional point upsampling methods in quantitative and qualitative measures. We also confirm that when PillarGen is incorporated into bird's eye view object detection, a significant improvement in detection accuracy is achieved.


title: Separation between Entanglement Criteria and Entanglement Detection Protocols

abstract: Entanglement detection is one of the most fundamental tasks in quantum information science, playing vital roles in theoretical studies and quantum system benchmarking. Researchers have proposed many powerful entanglement criteria with high detection capabilities and small observable numbers. Nonetheless, entanglement criteria only represent mathematical rules deciding the existence of entanglement. The relationship between a good entanglement criterion and an effective experimental entanglement detection protocol (EDP) is poorly understood. In this study, we introduce postulates for EDPs about their detection capabilities and robustness and use them to show the difference between entanglement criteria and EDPs. Specifically, we design an entanglement detection task for unknown pure bipartite states and demonstrate that the sample complexity of any EDP and the number of observables for a good entanglement criterion can have exponential separation. Furthermore, we discover that the optimal EDP with the lowest sample complexity does not necessarily correspond to the optimal entanglement criterion with the fewest observables. Our results can be used to prove the exponential speedups achieved through quantum memory and be generalized to multipartite entanglement detection. By highlighting the significance and independence of EDP design, our work holds practical implications for entanglement detection experiments.


title: Disorder-Induced Anomalous Mobility Enhancement in Confined Geometries

abstract: Strong, scale-free disorder disrupts typical transport properties like the Stokes-Einstein relation and linear response, leading to anomalous, non-diffusive motion observed in amorphous materials, glasses, living cells, and other systems. Our study reveals that the combination of scale-free quenched disorder and geometrical constraints induces unconventional single particle mobility behavior. Specifically, in a $2$-dimensional channel with width $w$, under external drive, tighter geometrical constraints (smaller $w$) enhance mobility. We derive an explicit form of the response to an external force by utilizing the double-subordination approach for the quenched trap model. The observed mobility enhancement occurs in the low-temperature regime where the distribution of localization times is scale-free.


title: Improving Adversarial Energy-Based Model via Diffusion Process

abstract: Generative models have shown strong generation ability while efficient likelihood estimation is less explored. Energy-based models~(EBMs) define a flexible energy function to parameterize unnormalized densities efficiently but are notorious for being difficult to train. Adversarial EBMs introduce a generator to form a minimax training game to avoid expensive MCMC sampling used in traditional EBMs, but a noticeable gap between adversarial EBMs and other strong generative models still exists. Inspired by diffusion-based models, we embedded EBMs into each denoising step to split a long-generated process into several smaller steps. Besides, we employ a symmetric Jeffrey divergence and introduce a variational posterior distribution for the generator's training to address the main challenges that exist in adversarial EBMs. Our experiments show significant improvement in generation compared to existing adversarial EBMs, while also providing a useful energy function for efficient density estimation.


title: Fisher-KPP-type models of biological invasion: Open source computational tools, key concepts and analysis

abstract: This review provides open-access computational tools that support a range of mathematical approaches to analyse three related scalar reaction-diffusion models used to study biological invasion. Starting with the classic Fisher-Kolmogorov (Fisher-KPP) model, we illustrate how computational methods can be used to explore time-dependent partial differential equation (PDE) solutions in parallel with phase plane and regular perturbation techniques to explore invading travelling wave solutions moving with dimensionless speed $c \ge 2$. To overcome the lack of a well-defined sharp front in solutions of the Fisher-KPP model, we also review two alternative modeling approaches. The first is the Porous-Fisher model where the linear diffusion term is replaced with a degenerate nonlinear diffusion term. Using phase plane and regular perturbation methods, we explore the distinction between sharp- and smooth-fronted invading travelling waves that move with dimensionless speed $c \ge 1/\sqrt{2}$. The second alternative approach is to reformulate the Fisher-KPP model as a moving boundary problem on $0 < x < L(t)$, leading to the Fisher-Stefan model with sharp-fronted travelling wave solutions arising from a PDE model with a linear diffusion term. Time-dependent PDE solutions and phase plane methods show that travelling wave solutions of the Fisher-Stefan model can describe both biological invasion $(c > 0)$ and biological recession $(c < 0)$. Open source Julia code to replicate all computational results in this review is available on GitHub; we encourage researchers to use this code directly or to adapt the code as required for more complicated models.


title: Development of a near-infrared wide-field integral field unit by ultra-precision diamond cutting

abstract: Integral Field Spectroscopy (IFS) is an observational method to obtain spatially resolved spectra over a specific field of view (FoV) in a single exposure. In recent years, near-infrared IFS has gained importance in observing objects with strong dust attenuation or at high redshift. One limitation of existing near-infrared IFS instruments is their relatively small FoV, less than 100 arcsec$^2$, compared to optical instruments. Therefore, we have developed a near-infrared (0.9-2.5 $\mathrm{\mu}$m) image-slicer type integral field unit (IFU) with a larger FoV of 13.5 $\times$ 10.4 arcsec$^2$ by matching a slice width to a typical seeing size of 0.4 arcsec. The IFU has a compact optical design utilizing off-axis ellipsoidal mirrors to reduce aberrations. Complex optical elements were fabricated using an ultra-precision cutting machine to achieve RMS surface roughness of less than 10 nm and a P-V shape error of less than 300 nm. The ultra-precision machining can also simplify alignment procedures. The on-sky performance evaluation confirmed that the image quality and the throughput of the IFU were as designed. In conclusion, we have successfully developed a compact IFU utilizing an ultra-precision cutting technique, almost fulfilling the requirements.