title: Ask for Alice: Online Covert Distress Signal in the Presence of a Strong Adversary

abstract: In this paper we propose a protocol that can be used to covertly send a distress signal through a seemingly normal webserver, even if the adversary is monitoring both the network and the user's device. This allows a user to call for help even when they are in the same physical space as their adversaries. We model such a scenario by introducing a strong adversary model that captures a high degree of access to the user's device and full control over the network. Our model fits into scenarios where a user is under surveillance and wishes to inform a trusted party of the situation. To do this, our method uses existing websites to act as intermediaries between the user and a trusted backend; this enables the user to initiate the distress signal without arousing suspicion, even while being actively monitored. We accomplish this by utilising the TLS handshake to convey additional information; this means that any website wishing to participate can do so with minimal effort and anyone monitoring the traffic will just see common TLS connections. In order for websites to be willing to host such a functionality the protocol must coexist gracefully with users who use normal TLS and the computational overhead must be minimal. We provide a full security analysis of the architecture and prove that the adversary cannot distinguish between a set of communications which contains a distress call and a normal communication.


title: Large-scale mean flow and inclination of isolated turbulent band in channel flow

abstract: Isolated turbulent bands observed in transitional channel flows have downstream heads and inclined bulks at a characteristic angle. In the large-scale mean flow, a $\nu$-shape vortex found at the head elongates into the bulk part, forming a pair of counter-rotating vortex tube structures. It is revealed numerically and theoretically that the head and the bulk convection velocities reflect the obliquely forward and the backward self-induced velocities of the $\nu$-shape vortex and the vortex tube pair, respectively, and the difference between these convection velocities provides a restoring angular momentum to retain the characteristic inclination angle through a self-adjustment process.


title: Roadmaps with Gaps over Controllers: Achieving Efficiency in Planning under Dynamics

abstract: This paper aims to improve the computational efficiency of motion planning for mobile robots with non-trivial dynamics through the use of learned controllers. It adopts a decoupled strategy, where a system-specific controller is first trained offline in an empty environment to deal with the robot's dynamics. For a target environment, the proposed approach constructs offline a data structure, a "Roadmap with Gaps," to approximately learn how to solve planning queries in this environment using the learned controller. The nodes of the roadmap correspond to local regions. Edges correspond to applications of the learned control policy that approximately connect these regions. Gaps arise because the controller does not perfectly connect pairs of individual states along edges. Online, given a query, a tree sampling-based motion planner uses the roadmap so that the tree's expansion is informed towards the goal region. The tree expansion selects local subgoals given a wavefront on the roadmap that guides towards the goal. When the controller cannot reach a subgoal region, the planner resorts to random exploration to maintain probabilistic completeness and asymptotic optimality. The accompanying experimental evaluation shows that the approach significantly improves the computational efficiency of motion planning on various benchmarks, including physics-based vehicular models on uneven and varying friction terrains as well as a quadrotor under air pressure effects.


title: Learning Hierarchical Relational Representations through Relational Convolutions

abstract: A maturing area of research in deep learning is the study of architectures and inductive biases for learning representations of relational features. In this paper, we focus on the problem of learning representations of hierarchical relations, proposing an architectural framework we call "relational convolutional networks". Given a collection of objects, pairwise relations are modeled via inner products of feature maps. We formalize a relational convolution operation in which graphlet filters are matched against patches of the input (i.e, groupings of objects), capturing the relational pattern in each group of objects. We also propose mechanisms for explicitly learning groupings of objects which are relevant to the downstream task. Composing these operations yields representations of higher-order, hierarchical relations. We present the motivation and details of the architecture, together with a set of experiments to demonstrate how relational convolutional networks can provide an effective framework for modeling relational tasks that have hierarchical structure.


title: Global exponential stability (and contraction of an unforced system) does not imply entrainment to periodic inputs

abstract: It is often of interest to know which systems will approach a periodic trajectory when given a periodic input. Results are available for certain classes of systems, such as contracting systems, showing that they always entrain to periodic inputs. In contrast to this, we demonstrate that there exist systems which are globally exponentially stable yet do not entrain to a periodic input. This could be seen as surprising, as it is known that globally exponentially stable systems are in fact contracting with respect to some Riemannian metric.


title: Calibrating VLBI Polarization Data Using GPCAL. I. Frequency-Dependent Calibration

abstract: In this series of papers, we present new methods of frequency- and time-dependent instrumental polarization calibration for Very Long Baseline Interferometry (VLBI). In most existing calibration tools and pipelines, it has been assumed that instrumental polarization is constant over frequency within the instrument bandwidth and over time. The assumption is not always true and may prevent an accurate calibration, which can result in degradation of the quality of linear polarization images. In this paper, we present a method of frequency-dependent instrumental polarization calibration that is implemented in GPCAL, a recently developed polarization calibration pipeline. The method is tested using simulated data sets generated from real Very Long Baseline Array (VLBA) data. We present the results of appyling the method to real VLBA data sets observed at 15 and 43 GHz. We were able to eliminate significant variability in cross-hand visibilities over frequency that is caused by frequency-dependent instrumental polarization. As a result of the calibration, linear polarization images were slightly to modestly improved as compared to those obtained without frequency-dependent instrumental polarization calibration. We discuss the reason for the minor impact of frequency-dependent instrumental polarization calibration on existing VLBA data sets and prospects for applying the method to future VLBI data sets, which are expected to provide very large bandwidths.


title: Sparse Deep Learning for Time Series Data: Theory and Applications

abstract: Sparse deep learning has become a popular technique for improving the performance of deep neural networks in areas such as uncertainty quantification, variable selection, and large-scale network compression. However, most existing research has focused on problems where the observations are independent and identically distributed (i.i.d.), and there has been little work on the problems where the observations are dependent, such as time series data and sequential data in natural language processing. This paper aims to address this gap by studying the theory for sparse deep learning with dependent data. We show that sparse recurrent neural networks (RNNs) can be consistently estimated, and their predictions are asymptotically normally distributed under appropriate assumptions, enabling the prediction uncertainty to be correctly quantified. Our numerical results show that sparse deep learning outperforms state-of-the-art methods, such as conformal predictions, in prediction uncertainty quantification for time series data. Furthermore, our results indicate that the proposed method can consistently identify the autoregressive order for time series data and outperform existing methods in large-scale model compression. Our proposed method has important practical implications in fields such as finance, healthcare, and energy, where both accurate point estimates and prediction uncertainty quantification are of concern.


title: Calibrating VLBI Polarization Data Using GPCAL. II. Time-Dependent Calibration

abstract: We present a new method of time-dependent instrumental polarization calibration for Very Long Baseline Interferometry (VLBI). This method has been implemented in the recently developed polarization calibration pipeline GPCAL. Instrumental polarization, also known as polarimetric leakage, is a direction-dependent effect, and it is not constant across the beam of a telescope. Antenna pointing model accuracy is usually dependent on time, resulting in off-axis polarimetric leakages that can vary with time. The method is designed to correct for the off-axis leakages with large amplitudes that can severely degrade linear polarization images. Using synthetic data generated based on real Very Long Baseline Array (VLBA) data observed at 43 GHz, we evaluate the performance of the method. The method was able to reproduce the off-axis leakages assumed in the synthetic data, particularly those with large amplitudes. The method has been applied to two sets of real VLBA data and the derived off-axis leakages show very similar trends over time for pairs of nearby sources. Furthermore, the amplitudes of the off-axis leakages are strongly correlated with the antenna gain correction factors. The results demonstrate that the method is capable of correcting for the off-axis leakages present in VLBI data. By calibrating time-dependent instrumental polarization, the rms-noise levels of the updated linear polarization images have been significantly reduced. The method is expected to substantially enhance the quality of linear polarization images obtained from existing and future VLBI observations.


title: JWST transmission spectroscopy of HD 209458b: a super-solar metallicity, a very low C/O, and no evidence of CH4, HCN, or C2H2

abstract: We present the transmission spectrum of the original transiting hot Jupiter HD\,209458b from 2.3 -- 5.1 $\mu$m as observed with the NIRCam instrument on the James Webb Space Telescope (JWST). Previous studies of HD 209458b's atmosphere have given conflicting results on the abundance of H$_2$O and the presence of carbon- and nitrogen-bearing species, which have significant ramifications on the inferences of the planet's metallicity (M/H) and carbon-to-oxygen (C/O) ratio. We detect strong features of H$_2$O and CO$_2$ in the JWST transmission spectrum, which when interpreted using a retrieval that assumes thermochemical equilibrium and fractional grey cloud opacity yields $3^{+4}_{-1}$ $\times$ solar metallicity and C/O = $0.11^{+0.12}_{-0.06}$. The derived metallicity is consistent with the atmospheric metallicity-planet mass trend observed in solar gas giants. The low C/O ratio suggests that this planet has undergone significant contamination by evaporating planetesimals while migrating inward. We are also able to place upper limits on the abundances of CH$_4$, C$_2$H$_2$ and HCN of log($\chi_{\mathrm{CH}_4}$) = -5.6, log($\chi_{\mathrm{C}_2\mathrm{H}_2}$) = -5.7, and log($\chi_{\mathrm{HCN}}$) = -5.1, which are in tension with the recent claim of a detection of these species using ground-based cross-correlation spectroscopy. We find that HD\,209458b has a weaker CO$_2$ feature size than WASP-39b when comparing their scale-height-normalized transmission spectra. On the other hand, the size of HD 209458b's H$_2$O feature is stronger, thus reinforcing the low C/O inference.


title: ${\tt MORALS}$: Analysis of High-Dimensional Robot Controllers via Topological Tools in a Latent Space

abstract: Estimating the region of attraction (${\tt RoA}$) for a robot controller is essential for safe application and controller composition. Many existing methods require a closed-form expression that limit applicability to data-driven controllers. Methods that operate only over trajectory rollouts tend to be data-hungry. In prior work, we have demonstrated that topological tools based on ${\it Morse Graphs}$ (directed acyclic graphs that combinatorially represent the underlying nonlinear dynamics) offer data-efficient ${\tt RoA}$ estimation without needing an analytical model. They struggle, however, with high-dimensional systems as they operate over a state-space discretization. This paper presents ${\it Mo}$rse Graph-aided discovery of ${\it R}$egions of ${\it A}$ttraction in a learned ${\it L}$atent ${\it S}$pace (${\tt MORALS}$). The approach combines auto-encoding neural networks with Morse Graphs. ${\tt MORALS}$ shows promising predictive capabilities in estimating attractors and their ${\tt RoA}$s for data-driven controllers operating over high-dimensional systems, including a 67-dim humanoid robot and a 96-dim 3-fingered manipulator. It first projects the dynamics of the controlled system into a learned latent space. Then, it constructs a reduced form of Morse Graphs representing the bistability of the underlying dynamics, i.e., detecting when the controller results in a desired versus an undesired behavior. The evaluation on high-dimensional robotic datasets indicates data efficiency in ${\tt RoA}$ estimation.


title: Robust globally divergence-free Weak Galerkin finite element method for incompressible Magnetohydrodynamics flow

abstract: This paper develops a weak Galerkin (WG) finite element method of arbitrary order for the steady incompressible Magnetohydrodynamics equations. The WG scheme uses piecewise polynomials of degrees $k(k\geq 1),k,k-1$, and $k-1$ respectively for the approximations of the velocity, the magnetic field, the pressure, and the magnetic pseudo-pressure in the interior of elements, and uses piecewise polynomials of degree $k$ for their numerical traces on the interfaces of elements. The method is shown to yield globally divergence-free approximations of the velocity and magnetic fields. We give existence and uniqueness results for the discrete scheme and derive optimal a priori error estimates. We also present a convergent linearized iterative algorithm. Numerical experiments are provided to verify the obtained theoretical results.


title: Xcrum: A Synergistic Approach Integrating Extreme Programming with Scrum

abstract: In today's modern world, software plays a pivotal role. Software development is a highly complex and time-consuming process, demanding multidimensional efforts. Companies continually adapt their requirements to align with the evolving environment, with a specific emphasis on rapid delivery and the acceptance of changing requirements. Traditional models, such as plan-driven development, often fall short in meeting these demands. In the realm of software development, Agile has been the focal point of global discourse for both researchers and developers. Agile development is better suited to customize and streamline the development process, offering a highly flexible, early, and rapid delivery lifecycle conducive to efficient software development. This article aims to provide an overview of two prominent Agile methodologies: Scrum and Extreme Programming (XP). It achieves this by reviewing relevant publications, analyzing their impact on software development, exploring the distinctive features of each methodology, and conducting a comparative assessment. Furthermore, the article offers personal insights and recommendations. Notably, the integration of XP practices into Scrum has given rise to a novel hybrid methodology known as "Xcrum," which retains its agility. It should be highlighted that, given this new approach's incorporation of the strengths of both methods, it holds the potential to outperform the original frameworks.


title: Can Large Language Models be Good Path Planners? A Benchmark and Investigation on Spatial-temporal Reasoning

abstract: Large language models (LLMs) have achieved remarkable success across a wide spectrum of tasks; however, they still face limitations in scenarios that demand long-term planning and spatial reasoning. To facilitate this line of research, in this work, we propose a new benchmark, termed $\textbf{P}$ath $\textbf{P}$lanning from $\textbf{N}$atural $\textbf{L}$anguage ($\textbf{PPNL}$). Our benchmark evaluates LLMs' spatial-temporal reasoning by formulating ''path planning'' tasks that require an LLM to navigate to target locations while avoiding obstacles and adhering to constraints. Leveraging this benchmark, we systematically investigate LLMs including GPT-4 via different few-shot prompting methodologies as well as BART and T5 of various sizes via fine-tuning. Our experimental results show the promise of few-shot GPT-4 in spatial reasoning, when it is prompted to reason and act interleavedly, although it still fails to perform long-term temporal reasoning. In contrast, while fine-tuned LLMs achieved impressive results on in-distribution reasoning tasks, they struggled to generalize to larger environments or environments with more obstacles.


title: Simulation method for evaporative cooling of trapped Bose gases at finite temperatures

abstract: We develop a simulation method for evaporative cooling of trapped Bose-Einstein condensate at finite temperatures using Zaremba-Nikuni-Griffin (ZNG) formalism. ZNG formalism includes the generalized GP equation and a semiclassical kinetic equation for the thermal cloud, which treats the excitations semiclassically within the Hartree Fock approximation. The generalized GP equation includes the mean field due to the thermal cloud and the source term associated with collisions between the condensate and the thermal cloud. Our method is based on the numerical approach developed by Jackson and Zaremba, which simulates the kinetic equation using test particles. A key point of our method is to mimic the evaporative cooling process by eliminating the test particles with high energy. We show that our method successfully describes condensate growth during evaporative cooling. We also numerically simulate vortex lattice formation during evaporative cooling in the presence of the rotating thermal cloud.


title: Efficient Video and Audio processing with Loihi 2

abstract: Loihi 2 is an asynchronous, brain-inspired research processor that generalizes several fundamental elements of neuromorphic architecture, such as stateful neuron models communicating with event-driven spikes, in order to address limitations of the first generation Loihi. Here we explore and characterize some of these generalizations, such as sigma-delta encapsulation, resonate-and-fire neurons, and integer-valued spikes, as applied to standard video, audio, and signal processing tasks. We find that these new neuromorphic approaches can provide orders of magnitude gains in combined efficiency and latency (energy-delay-product) for feed-forward and convolutional neural networks applied to video, audio denoising, and spectral transforms compared to state-of-the-art solutions.


title: Exploring age-related patterns in internet access: Insights from a secondary analysis of New Zealand survey data

abstract: About thirty years ago, when the Internet started to be commercialised, access to the medium became a topic of research and debate. Up-to-date evidence about key predictors, such age, is crucial because of the Internet's ever-changing nature and the challenges associated with gaining access to it. This paper aims to give an overview of New Zealand's Internet access trends and how they relate to age. It is based on secondary analysis of data from a larger online panel survey with 1,001 adult respondents. The Chi-square test of independence and Cramer's V were used in the analysis. The study provides new evidence to understand the digital divide. Specifically, it uncovers a growing disparity in the quality of Internet connectivity. Even though fibre is the most common type of broadband connection at home, older adults are less likely to have it and more likely to use wireless broadband, which is a slower connection type. Additionally, a sizable majority of people in all age categories have favourable opinions on the Internet. Interestingly, this was more prevalent among older people, although they report an increased concern about the security of their personal information online. The implications of the results are discussed and some directions for future research are proposed.


title: Molecule Design by Latent Prompt Transformer

abstract: This paper proposes a latent prompt Transformer model for solving challenging optimization problems such as molecule design, where the goal is to find molecules with optimal values of a target chemical or biological property that can be computed by an existing software. Our proposed model consists of three components. (1) A latent vector whose prior distribution is modeled by a Unet transformation of a Gaussian white noise vector. (2) A molecule generation model that generates the string-based representation of molecule conditional on the latent vector in (1). We adopt the causal Transformer model that takes the latent vector in (1) as prompt. (3) A property prediction model that predicts the value of the target property of a molecule based on a non-linear regression on the latent vector in (1). We call the proposed model the latent prompt Transformer model. After initial training of the model on existing molecules and their property values, we then gradually shift the model distribution towards the region that supports desired values of the target property for the purpose of molecule design. Our experiments show that our proposed model achieves state of the art performances on several benchmark molecule design tasks.


title: Non-coresident family as a driver of migration change in a crisis: The case of the COVID-19 pandemic

abstract: Changes in U.S. migration during the COVID-19 pandemic show that many moved to less populated cities from larger cities, deviating from previous trends. In this study, building on prior work in the literature showing that the abundance of family ties is inversely related to population size, we analyze these migration changes with a focus on the crucial, yet overlooked factor of extended family. Employing two large-scale data sets, census microdata and mobile phone GPS relocation data, we show a collection of empirical results that paints a picture of migration change affected by kin. Namely, we find that people migrated closer to family at higher rates after the COVID-19 pandemic started. Moreover, even controlling for factors such as population density and cost of living, we find that changes in net in-migration tended to be larger and positive in cities with larger proportions of people who can be parents to adult children (our proxy for parental family availability, which is also inversely related to population size). Our study advances the demography-disaster nexus and amplifies ongoing literature highlighting the role of broader kinship systems in large-scale socioeconomic phenomena.


title: Global solutions to Stokes-Magneto equations with fractional dissipations

abstract: In this paper, we investigate a Stokes-Magneto system with fractional diffusions. We first deal with the non-resistive case in $\mathbb{T}^{d}$ and establish the local and global well-posedness with initial magnetic field $\mathbf{b}_0\in H^{s}(\mathbb{T}^d)$. We also show the existence of a unique mild solution of the resistive case with initial data $\mathbf{b}_0$ in the critical $L^{p}(\mathbb{R}^d)$ space. Moreover, we show that $\|\mathbf{b}(t)\|_{L^{p}}$ converges to zero as $t\rightarrow\infty$ when the initial data is sufficiently small.


title: Toward One-Second Latency: Evolution of Live Media Streaming

abstract: This survey presents the evolution of live media streaming and the technological developments behind today's IP-based low-latency live streaming systems. Live streaming primarily involves capturing, encoding, packaging and delivering real-time events such as live sports, live news, personal broadcasts and surveillance videos. Live streaming also involves concurrent streaming of linear TV programming off the satellite, cable, over-the-air or IPTV broadcast, where the programming is not necessarily a real-time event. The survey starts with a discussion on the latency and latency continuum in streaming applications. Then, it lays out the existing live streaming workflows and protocols, followed by an in-depth analysis of the latency sources in these workflows and protocols. The survey continues with the technology enablers, low-latency extensions for the popular HTTP adaptive streaming methods and enhancements for robust low-latency playback. An entire section is dedicated to the detailed summary and findings of Twitch's grand challenge on low-latency live streaming. The survey concludes with a discussion of ongoing research problems in this space.


title: On Matou\v{s}ek-like Embedding Obstructions of Countably Branching Graphs

abstract: In this paper we present new proofs of the non-embeddability of countably branching trees into Banach spaces satisfying property $(\beta_p)$ and of countably branching diamonds into Banach spaces which are $p$-AMUC for $p > 1$. These proofs are entirely metric in nature and are inspired by previous work of Ji\v{r}\'i Matou\v{s}ek. In addition, using this metric method, we succeed in extending these results to metric spaces satisfying certain curvature-like inequalities. Finally, we extend an embedding result of Tessera to give lower bounds on the compression for a class of Lipschitz embeddings of the countably branching trees into Banach spaces containing $\ell_p$-asymptotic models for $p \geq 1$.


title: Assessing Electricity Service Unfairness with Transfer Counterfactual Learning

abstract: Energy justice is a growing area of interest in interdisciplinary energy research. However, identifying systematic biases in the energy sector remains challenging due to confounding variables, intricate heterogeneity in counterfactual effects, and limited data availability. First, this paper demonstrates how one can evaluate counterfactual unfairness in a power system by analyzing the average causal effect of a specific protected attribute. Subsequently, we use subgroup analysis to handle model heterogeneity and introduce a novel method for estimating counterfactual unfairness based on transfer learning, which helps to alleviate the data scarcity in each subgroup. In our numerical analysis, we apply our method to a unique large-scale customer-level power outage data set and investigate the counterfactual effect of demographic factors, such as income and age of the population, on power outage durations. Our results indicate that low-income and elderly-populated areas consistently experience longer power outages under both daily and post-disaster operations, and such discrimination is exacerbated under severe conditions. These findings suggest a widespread, systematic issue of injustice in the power service systems and emphasize the necessity for focused interventions in disadvantaged communities.


title: The EDIBLES Survey. VII. A survey of C2 and C3 in interstellar clouds

abstract: We carried out a sensitive survey of C$_2$ and C$_3$ using the EDIBLES data set. We also expanded our searches to C$_4$, C$_5$, and $^{13}$C$^{12}$C isotopologue in the most molecule-rich sightlines. We fit synthetic spectra generated following a physical excitation model to the C$_2$ (2-0) Phillips band to obtain the C$_2$ column density ($N$) as well as the kinetic temperature ($T_\textrm{kin}$) and number density ($n$) of the host cloud. The C$_3$ molecule was measured through its $\tilde{A} - \tilde{X}$ (000-000) electronic origin band system. We simulated the excitation of this band with a double-temperature Boltzmann distribution. We present the largest combined survey of C$_2$ and C$_3$ to date in which the individual transitions can be resolved. In total we detected C$_2$ in 51 velocity components along 40 sightlines, and C$_3$ in 31 velocity components along 27 sightlines. The two molecules are detected in the same velocity components. We find a very good correlation between $N$(C$_2$) and $N$(C$_3$) with Pearson $r = 0.93$ and an average $N$(C$_2$)/$N$(C$_3$) ratio of 15.5$\pm$1.4. A comparison with the behaviour of the C$_2$ DIBs shows that there are no clear differences among sightlines with and without detection of C$_2$ and C$_3$. This is in direct contrast to the better-studied non-C$_2$ DIBs who have reduced strengths in molecule-rich environments. We also identify for the first time the $Q$(2), $Q$(3), and $Q$(4) transitions of the $^{13}$C$^{12}$C (2-0) Phillips band in a stacked average spectrum, and estimate the isotopic ratio of carbon $^{12}$C/$^{13}$C as 79$\pm$8. Our search for the C$_4$ and C$_5$ optical bands was unsuccessful.


title: Application Potential of a Hybrid Ground Source Heat Pump Array for the UC Berkeley Campus Business and Law Node Energy System: A Preliminary Study

abstract: The current plan divides the UC Berkeley (UCB) campus energy system into five nodes, where the Business and Law node was studied because of an open field site for borehole installation. The Pacific Northwest National Laboratory's Commercial Prototype Building Models were used to estimate heating and cooling load requirements for UCB campus building types by considering model characteristics (for example, high base load from hospitals, high DHW in hotels) corresponding to the ASHRAE Standard 90.1-2013. Unscaled load profiles were created from the EnergyPlus building energy simulation and scaled with monitored peak load and annual energy use to generate the target node's hourly heating and cooling load profiles. An optimization problem was solved to design a hybrid GSHP system, where the objective function is the lifetime total cost of the system, and the optimization variables are the portion of heating and cooling loads covered by the GSHP system. Modelica models for air source and ground source heat pump systems were built for detailed case studies based on optimization results. In the Modelica model, the demand side is connected to the radiators in the building to transfer heat, and the source side is connected to GSHP, ASHP, or other heating and cooling facilities. The results demonstrate that an appropriate hybrid GSHP system can help reduce both borehole numbers and electricity consumption for the UCB campus site.


title: Climate Change and Future Food Security: Predicting the Extent of Cropland Gain or Degradation

abstract: Agriculture is crucial in sustaining human life and civilization that relies heavily on natural resources. This industry faces new challenges, such as climate change, a growing global population, and new models for managing food security and water resources. Through a machine learning framework, we estimate the future productivity of croplands based on CMIP5 climate projections on moderate carbon emission scenario. We demonstrate that Vietnam and Thailand are at risk with a 10\% and 14\% drop in rice production, respectively, whereas the Philippines is expected to increase its output by 11\% by 2026 compared with 2018. We urge proactive international collaboration between regions facing crop land gain and degradation to mitigate the climate change and population growth impacts reducing our society's vulnerability. Our study provides critical information on the effects of climate change and human activities on land productivity and uses that may assist such collaboration.


title: Predicting Emergent Abilities with Infinite Resolution Evaluation

abstract: The scientific scale-up of large language models (LLMs) necessitates a comprehensive understanding of their scaling properties. However, the existing literature on the scaling properties only yields an incomplete answer: optimization loss decreases predictably as the model size increases, in line with established scaling law; yet no scaling law for task has been established and the task performances are far from predictable during scaling. Task performances typically show minor gains on small models until they improve dramatically once models exceed a size threshold, exemplifying the ``emergent abilities''. In this study, we discover that small models, although they exhibit minor performance, demonstrate critical and consistent task performance improvements that are not captured by conventional evaluation strategies due to insufficient measurement resolution. To measure such improvements, we introduce PassUntil, an evaluation strategy with theoretically infinite resolution, through massive sampling in the decoding phase. With PassUntil, we conduct a quantitative investigation into the scaling law of task performance. The investigation contains two parts. Firstly, a strict task scaling law that is not conventionally known to exist, is identified, enhancing the predictability of task performances. Remarkably, we are able to predict the performance of the 2.4B model on code generation with merely 0.05\% deviation before training starts, which is the first systematic attempt to verify predictable scaling proposed by GPT-4's report. Secondly, we are able to study emergent abilities quantitatively. We identify a kind of accelerated emergence whose scaling curve cannot be fitted by standard scaling law function and has a increasing speed. We then examine two hypothesis and imply that the ``multiple circuits hypothesis'' might be responsible for the accelerated emergence.


title: The Intracluster Light and its Link with the Dynamical State of the Host Group/Cluster: the Role of the Halo Concentration

abstract: We investigate on the role of the halo concentration in the formation of the intra-cluster light (ICL) in galaxy groups and clusters, as predicted by a state-of-art semi-analytic model of galaxy formation, coupled with a set of high-resolution dark matter only simulations. The analysis focuses on how the fraction of ICL correlates with halo mass, concentration and fraction of early-type galaxies (ETGs) in a large sample of groups and clusters with $13.0\leq \log M_{halo} \leq 15.0$. The fraction of ICL follows a normal distribution, a consequence of the stochastic nature of the physical processes responsible for the formation of the diffuse light. The fractional budget of ICL depends on both halo mass (very weakly) until group scales, and concentration (remarkably). More interestingly, the ICL fraction is higher in more concentrated objects, a result of the stronger tidal forces acting in the innermost regions of the haloes where the concentration is the quantity playing the most relevant role. Our model predictions do not show any dependence between the ICL and ETGs fractions and so, we instead suggest the concentration rather than the mass, as recently claimed, to be the main driver of the ICL formation. The diffuse light starts to form in groups via stellar stripping and mergers and later assembled in more massive objects. However, the formation and assembly keep going on group/cluster scales at lower redshift through the same processes, mainly via stellar stripping in the vicinity of the central regions where tidal forces are stronger.


title: Bias-preserving computation with the bit-flip code

abstract: We explore the feasibility of fault-tolerant quantum computation using the bit-flip repetition code in a biased noise channel where only the bit-flip error can occur. While several logic gates can potentially produce phase-flip errors even in such a channel, we propose bias-preserving implementation of $S$, $H$, $\mathrm{CZ}$, and $R_z$ gates. We demonstrate that our scheme improves the computational precision in several tasks such as the time evolution of quantum systems and variational quantum eigensolver.


title: Integrated Communication, Sensing, and Computation Framework for 6G Networks

abstract: In the sixth generation (6G) era, intelligent machine network (IMN) applications, such as intelligent transportation, require collaborative machines with communication, sensing, and computation (CSC) capabilities. This article proposes an integrated communication, sensing, and computation (ICSAC) framework for 6G to achieve the reciprocity among CSC functions to enhance the reliability and latency of communication, accuracy and timeliness of sensing information acquisition, and privacy and security of computing to realize the IMN applications. Specifically, the sensing and communication functions can merge into unified platforms using the same transmit signals, and the acquired real-time sensing information can be exploited as prior information for intelligent algorithms to enhance the performance of communication networks. This is called the computing-empowered integrated sensing and communications (ISAC) reciprocity. Such reciprocity can further improve the performance of distributed computation with the assistance of networked sensing capability, which is named the sensing-empowered integrated communications and computation (ICAC) reciprocity. The above ISAC and ICAC reciprocities can enhance each other iteratively and finally lead to the ICSAC reciprocity. To achieve these reciprocities, we explore the potential enabling technologies for the ICSAC framework. Finally, we present the evaluation results of crucial enabling technologies to show the feasibility of the ICSAC framework.


title: UniPredict: Large Language Models are Universal Tabular Classifiers

abstract: Tabular data prediction is a fundamental machine learning task for many applications. Existing methods predominantly employ discriminative modeling and operate under the assumption of a fixed target column, necessitating re-training for every new predictive task. Inspired by the generative power of large language models (LLMs), this paper exploits the idea of building universal tabular data predictors based on generative modeling, namely UniPredict. Here, we demonstrate the scalability of an LLM to extensive tabular datasets, enabling it to comprehend diverse tabular inputs and predict target variables following the provided instructions. Specifically, we train a single LLM on an aggregation of 169 tabular datasets with diverse targets and compare its performance against baselines that are trained on each dataset separately. We observe this versatile UniPredict model demonstrates an advantage over other models, ranging from 5.4% to 13.4%, when compared with the best tree-boosting baseline and the best neural network baseline, respectively. We further test UniPredict in few-shot learning settings on another 62 tabular datasets. Our method achieves strong performance in quickly adapting to new tasks. In low-resource few-shot setup, we observed a 100%+ performance advantage compared with XGBoost, and significant margin over all baselines. We envision that UniPredict sheds light on developing a universal tabular data prediction system that learns from data at scale and serves a wide range of prediction tasks.


title: Machine Learning Detection of Correlations in Snapshots of Ultracold Atoms in Optical Lattices

abstract: Recent proposals have suggested the use of supervised learning with convolutional neural networks to shed light on some of the less well known phases of the Fermi-Hubbard model through the classification of snapshots from the quantum gas microscopy of ultracold atoms in optical lattices. However, there have been challenges in the interpretability of networks with more than one convolutional filter coupled to the input images. Here, we expand on previous work by considering multiple filters in the first convolutional layer and developing a process for analyzing the physical relevance of patterns obtained in the trained filters. We benchmark our approach at half-filling, where strong antiferromagnetic correlations are known to be present, and we find that upon hole doping, previously unknown patterns arise at temperatures below the tunneling amplitude. These patterns may be a signature of interesting arrangements of fermions in the lattice.


title: On the Distribution of SINR for Cell-Free Massive MIMO Systems

abstract: Cell-free (CF) massive multiple-input multiple-output (mMIMO) has been considered as a potential technology for Beyond 5G communication systems. However, the performance of CF mMIMO systems has not been well studied. Most existing analytical work on CF mMIMO systems is based on the expected signal-to-interference-plus-noise ratio (SINR). The statistical characteristics of the SINR, which is critical for emerging applications that focus on extreme events, have not been investigated. To address this issue, in this paper, we attempt to obtain the distribution of SINR in CF mMIMO systems. Considering a downlink CF mMIMO system with pilot contamination, we first give the closed-form expression of the SINR. Based on our analytical work on the two components of the SINR, i.e., desired signal and interference-plus-noise, we then derive the probability density function and cumulative distribution function of the SINR under maximum ratio transmission (MRT) and full-pilot zero-forcing (FZF) precoding, respectively. Subsequently, the closed-form expressions for two more sophisticated performance metrics, i.e., achievable rate and outage probability, can be obtained. Finally, we perform Monte Carlo simulations to validate our analytical work. The results demonstrate the effectiveness of the derived SINR distribution, achievable rate, and outage probability.


title: InstructProtein: Aligning Human and Protein Language via Knowledge Instruction

abstract: Large Language Models (LLMs) have revolutionized the field of natural language processing, but they fall short in comprehending biological sequences such as proteins. To address this challenge, we propose InstructProtein, an innovative LLM that possesses bidirectional generation capabilities in both human and protein languages: (i) taking a protein sequence as input to predict its textual function description and (ii) using natural language to prompt protein sequence generation. To achieve this, we first pre-train an LLM on both protein and natural language corpora, enabling it to comprehend individual languages. Then supervised instruction tuning is employed to facilitate the alignment of these two distinct languages. Herein, we introduce a knowledge graph-based instruction generation framework to construct a high-quality instruction dataset, addressing annotation imbalance and instruction deficits in existing protein-text corpus. In particular, the instructions inherit the structural relations between proteins and function annotations in knowledge graphs, which empowers our model to engage in the causal modeling of protein functions, akin to the chain-of-thought processes in natural languages. Extensive experiments on bidirectional protein-text generation tasks show that InstructProtein outperforms state-of-the-art LLMs by large margins. Moreover, InstructProtein serves as a pioneering step towards text-based protein function prediction and sequence design, effectively bridging the gap between protein and human language understanding.


title: EfficientDM: Efficient Quantization-Aware Fine-Tuning of Low-Bit Diffusion Models

abstract: Diffusion models have demonstrated remarkable capabilities in image synthesis and related generative tasks. Nevertheless, their practicality for real-world applications is constrained by substantial computational costs and latency issues. Quantization is a dominant way to compress and accelerate diffusion models, where post-training quantization (PTQ) and quantization-aware training (QAT) are two main approaches, each bearing its own properties. While PTQ exhibits efficiency in terms of both time and data usage, it may lead to diminished performance in low bit-width. On the other hand, QAT can alleviate performance degradation but comes with substantial demands on computational and data resources. In this paper, we introduce a data-free and parameter-efficient fine-tuning framework for low-bit diffusion models, dubbed EfficientDM, to achieve QAT-level performance with PTQ-like efficiency. Specifically, we propose a quantization-aware variant of the low-rank adapter (QALoRA) that can be merged with model weights and jointly quantized to low bit-width. The fine-tuning process distills the denoising capabilities of the full-precision model into its quantized counterpart, eliminating the requirement for training data. We also introduce scale-aware optimization and temporal learned step-size quantization to further enhance performance. Extensive experimental results demonstrate that our method significantly outperforms previous PTQ-based diffusion models while maintaining similar time and data efficiency. Specifically, there is only a 0.05 sFID increase when quantizing both weights and activations of LDM-4 to 4-bit on ImageNet 256x256. Compared to QAT-based methods, our EfficientDM also boasts a 16.2x faster quantization speed with comparable generation quality. Code is available at \href{https://github.com/ThisisBillhe/EfficientDM}{this hrl}.


title: Peltier effect of phonon driven by ac electromagnetic waves

abstract: Steady current in metals induces a thermal gradient, a phenomenon known as the Peltier effect. The Peltier effect is one of the fundamental phenomena in the thermoelectric properties of materials and is also used in applications such as refrigerators. In this work, we show that an analogous phenomenon occurs by phonons in a material subject to linearly-polarized light. Under light illumination, an energy current of phonons occurs through a nonlinear optical effect similar to the bulk photovoltaic effect. We formulate the nonlinear Peltier coefficient of the photogalvanic energy current carried by phonons using nonlinear response theory. From the general formula, we show that the photogalvanic energy current occurs only in a non-centrosymmetric system with two or more optical phonon bands. We demonstrate the generation of the photogalvanic energy current using a one-dimensional ion chain with three ions in a unit cell, which predicts the generation of an experimentally observable energy current using available THz-infrared light sources.


title: Network Alignment with Transferable Graph Autoencoders

abstract: Network alignment is the task of establishing one-to-one correspondences between the nodes of different graphs and finds a plethora of applications in high-impact domains. However, this task is known to be NP-hard in its general form, and existing algorithms do not scale up as the size of the graphs increases. To tackle both challenges we propose a novel generalized graph autoencoder architecture, designed to extract powerful and robust node embeddings, that are tailored to the alignment task. We prove that the generated embeddings are associated with the eigenvalues and eigenvectors of the graphs and can achieve more accurate alignment compared to classical spectral methods. Our proposed framework also leverages transfer learning and data augmentation to achieve efficient network alignment at a very large scale without retraining. Extensive experiments on both network and sub-network alignment with real-world graphs provide corroborating evidence supporting the effectiveness and scalability of the proposed approach.


title: Ablation Study to Clarify the Mechanism of Object Segmentation in Multi-Object Representation Learning

abstract: Multi-object representation learning aims to represent complex real-world visual input using the composition of multiple objects. Representation learning methods have often used unsupervised learning to segment an input image into individual objects and encode these objects into each latent vector. However, it is not clear how previous methods have achieved the appropriate segmentation of individual objects. Additionally, most of the previous methods regularize the latent vectors using a Variational Autoencoder (VAE). Therefore, it is not clear whether VAE regularization contributes to appropriate object segmentation. To elucidate the mechanism of object segmentation in multi-object representation learning, we conducted an ablation study on MONet, which is a typical method. MONet represents multiple objects using pairs that consist of an attention mask and the latent vector corresponding to the attention mask. Each latent vector is encoded from the input image and attention mask. Then, the component image and attention mask are decoded from each latent vector. The loss function of MONet consists of 1) the sum of reconstruction losses between the input image and decoded component image, 2) the VAE regularization loss of the latent vector, and 3) the reconstruction loss of the attention mask to explicitly encode shape information. We conducted an ablation study on these three loss functions to investigate the effect on segmentation performance. Our results showed that the VAE regularization loss did not affect segmentation performance and the others losses did affect it. Based on this result, we hypothesize that it is important to maximize the attention mask of the image region best represented by a single latent vector corresponding to the attention mask. We confirmed this hypothesis by evaluating a new loss function with the same mechanism as the hypothesis.


title: Fragment-based Pretraining and Finetuning on Molecular Graphs

abstract: Property prediction on molecular graphs is an important application of Graph Neural Networks. Recently, unlabeled molecular data has become abundant, which facilitates the rapid development of self-supervised learning for GNNs in the chemical domain. In this work, we propose pretraining GNNs at the fragment level, a promising middle ground to overcome the limitations of node-level and graph-level pretraining. Borrowing techniques from recent work on principal subgraph mining, we obtain a compact vocabulary of prevalent fragments from a large pretraining dataset. From the extracted vocabulary, we introduce several fragment-based contrastive and predictive pretraining tasks. The contrastive learning task jointly pretrains two different GNNs: one on molecular graphs and the other on fragment graphs, which represents higher-order connectivity within molecules. By enforcing consistency between the fragment embedding and the aggregated embedding of the corresponding atoms from the molecular graphs, we ensure that the embeddings capture structural information at multiple resolutions. The structural information of fragment graphs is further exploited to extract auxiliary labels for graph-level predictive pretraining. We employ both the pretrained molecular-based and fragment-based GNNs for downstream prediction, thus utilizing the fragment information during finetuning. Our graph fragment-based pretraining (GraphFP) advances the performances on 5 out of 8 common molecular benchmarks and improves the performances on long-range biological benchmarks by at least 11.5%. Code is available at: https://github.com/lvkd84/GraphFP.


title: Power Optimization in Multi-IRS Aided Delay-Constrained IoVT Systems

abstract: With the advancement of video sensors in the Internet of Things, Internet of Video Things (IoVT) systems, capable of delivering abundant and diverse information, have been increasingly deployed for various applications. However, the extensive transmission of video data in IoVT poses challenges in terms of delay and power consumption. Intelligent reconfigurable surface (IRS), as an emerging technology, can enhance communication quality and consequently improve system performance by reconfiguring wireless propagation environments. Inspired by this, we propose a multi-IRS aided IoVT system that leverages IRS to enhance communication quality, thereby reducing power consumption while satisfying delay requirements. To fully leverage the benefits of IRS, we jointly optimize power control for IoVT devices and passive beamforming for IRS to minimize long-term total power consumption under delay constraints. To solve this problem, we first utilize Lyapunov optimization to decouple the long-term optimization problem into each time slot. Subsequently, an alternating optimization algorithm employing optimal solution-seeking and fractional programming is proposed to effectively solve the optimization problems at each time slot. Simulation results demonstrate that the proposed algorithm significantly outperforms benchmark algorithms in terms of long-term total power consumption. Moreover, a trade-off between the number of IRS elements and system performance is also proved.


title: $W$ boson mass in gauge-Higgs unification

abstract: The $W$ boson mass $m_W$ in the GUT inspired $SO(5) \times U(1) \times SU(3)$ gauge-Higgs unification in the Randall-Sundrum (RS) warped space is evaluated. The muon decay $\mu^- \rightarrow e^- \bar{\nu}_e \nu_\mu$ proceeds by the exchange of not only the zero mode of the $W$ boson $(W^{(0)}$) but also Kaluza-Klein (KK) excited modes $W^{(n)}$ and $W_R^{(n)}$ ($n \ge 1$) at the tree level. The anti-de Sitter curvature of the RS space also affects the relationship among the gauge couplings and the ratio of $m_W$ to the $Z$ boson mass $m_Z$. The $W$ couplings of leptons and quarks also change. With the given KK mass scale $m_{\rm KK}$ the range of the Aharonov-Bohm phase $\theta_H$ in the fifth dimension is constrained. For $m_{\rm KK} = 13\,$TeV, $0.085 \lesssim \theta_H \lesssim 0.11$ and $80.381\,{\rm GeV} \lesssim m_W \lesssim 80.407\,{\rm GeV}$. The predicted value of $m_W$ for $13\, {\rm TeV} \le m_{\rm KK} \le 20\, {\rm TeV}$ lies between $m_W^{\rm SM} = 80.354 \pm 0.007\,$GeV in the standard model and $m_W^{\rm CDF} = 80.4335 \pm 0.0094\,$GeV, the value reported by the CDF collaboration in 2022.


title: 3D structure of HII regions in the star-forming complex S254-S258

abstract: The S254-258 star-forming complex is a place of massive star formation where five OB-stars have created HII regions, visible as optical nebulae, and disrupted the parental molecular gas. In this work, we study the 3D structure of these \HII regions using optical spectroscopy and tunable-filter photometry with the 6-m and 1-m telescopes of the Special Astrophysical Observatory of the Russian Academy of Sciences. We construct maps of the optical extinction, and find that the HII emission is attenuated by neutral material with $2 \leq A_V \leq 5$ mag. The typical electron density in S255, and S257 is $\approx 100$ cm$^{-3}$, with enhancements up to 200 cm$^{-3}$ in their borders, and up to 400 cm$^{-3}$ toward the dense molecular cloud between them, where active star formation is taking place. We show that either a model of a clumpy dense neutral shell, where UV~photons penetrate through and ionize the gas, or a stellar wind, can explain the shell-like structure of the ionized gas. S255 is surrounded by neutral material from all sides, but S257 is situated on the border of a molecular cloud and does not have dense front and rear walls. The compact HII regions S256 and S258 are deeply embedded in the molecular clouds.


title: Mitigating Pilot Contamination and Enabling IoT Scalability in Massive MIMO Systems

abstract: Massive MIMO is expected to play an important role in the development of 5G networks. This paper addresses the issue of pilot contamination and scalability in massive MIMO systems. The current practice of reusing orthogonal pilot sequences in adjacent cells leads to difficulty in differentiating incoming inter- and intra-cell pilot sequences. One possible solution is to increase the number of orthogonal pilot sequences, which results in dedicating more space of coherence block to pilot transmission than data transmission. This, in turn, also hinders the scalability of massive MIMO systems, particularly in accommodating a large number of IoT devices within a cell. To overcome these challenges, this paper devises an innovative pilot allocation scheme based on the data transfer patterns of IoT devices. The scheme assigns orthogonal pilot sequences to clusters of devices instead of individual devices, allowing multiple devices to utilize the same pilot for periodically transmitting data. Moreover, we formulate the pilot assignment problem as a graph coloring problem and use the max k-cut graph partitioning approach to overcome the pilot contamination in a multicell massive MIMO system. The proposed scheme significantly improves the spectral efficiency and enables the scalability of massive MIMO systems; for instance, by using ten orthogonal pilot sequences, we are able to accommodate 200 devices with only a 12.5% omission rate.


title: Classifying Whole Slide Images: What Matters?

abstract: Recently there have been many algorithms proposed for the classification of very high resolution whole slide images (WSIs). These new algorithms are mostly focused on finding novel ways to combine the information from small local patches extracted from the slide, with an emphasis on effectively aggregating more global information for the final predictor. In this paper we thoroughly explore different key design choices for WSI classification algorithms to investigate what matters most for achieving high accuracy. Surprisingly, we found that capturing global context information does not necessarily mean better performance. A model that captures the most global information consistently performs worse than a model that captures less global information. In addition, a very simple multi-instance learning method that captures no global information performs almost as well as models that capture a lot of global information. These results suggest that the most important features for effective WSI classification are captured at the local small patch level, where cell and tissue micro-environment detail is most pronounced. Another surprising finding was that unsupervised pre-training on a larger set of 33 cancers gives significantly worse performance compared to pre-training on a smaller dataset of 7 cancers (including the target cancer). We posit that pre-training on a smaller, more focused dataset allows the feature extractor to make better use of the limited feature space to better discriminate between subtle differences in the input patch.


title: Potential of the Cherenkov Telescope Array for studying the young nearby supernova remnants

abstract: Modern imaging atmospheric Cherenkov telescopes have extensively observed young nearby supernova remnants (SNRs), with ages of about 1000 years or less, in the very-high-energy (VHE) gamma-ray band. These efforts resulted in the detection of VHE emission from three young SNRs - Cassiopeia A, Tycho, and SN 1006 - and provided significant evidence for emission from the more distant Kepler's SNR. However, many questions on the production of VHE gamma rays in these remnants remain unanswered. Using detailed physical models for Tycho's SNR based on the CR-hydro-NEI code and physically motivated models for the other young nearby remnants, we simulated observations with the Cherenkov Telescope Array (CTA) of these gamma-ray sources. We highlight properties of these remnants accessible for investigation with future CTA observations and discuss which questions are expected to be answered.


title: A 5' UTR Language Model for Decoding Untranslated Regions of mRNA and Function Predictions

abstract: The 5' UTR, a regulatory region at the beginning of an mRNA molecule, plays a crucial role in regulating the translation process and impacts the protein expression level. Language models have showcased their effectiveness in decoding the functions of protein and genome sequences. Here, we introduced a language model for 5' UTR, which we refer to as the UTR-LM. The UTR-LM is pre-trained on endogenous 5' UTRs from multiple species and is further augmented with supervised information including secondary structure and minimum free energy. We fine-tuned the UTR-LM in a variety of downstream tasks. The model outperformed the best-known benchmark by up to 42% for predicting the Mean Ribosome Loading, and by up to 60% for predicting the Translation Efficiency and the mRNA Expression Level. The model also applies to identifying unannotated Internal Ribosome Entry Sites within the untranslated region and improves the AUPR from 0.37 to 0.52 compared to the best baseline. Further, we designed a library of 211 novel 5' UTRs with high predicted values of translation efficiency and evaluated them via a wet-lab assay. Experiment results confirmed that our top designs achieved a 32.5% increase in protein production level relative to well-established 5' UTR optimized for therapeutics.


title: Transposed Poisson Structures on the planar Galilean conformal algebra

abstract: Each $\frac{1}{2}$-derivation of the planar Galilean conformal algebra is proven to be a scalar. As a corollary, all transposed Poisson structures on the planar Galilean conformal algebra are trivial.


title: A Formalism and Approach for Improving Robustness of Large Language Models Using Risk-Adjusted Confidence Scores

abstract: Large Language Models (LLMs), such as ChatGPT, have achieved impressive milestones in natural language processing (NLP). Despite their impressive performance, the models are known to pose important risks. As these models are deployed in real-world applications, a systematic understanding of different risks posed by these models on tasks such as natural language inference (NLI), is much needed. In this paper, we define and formalize two distinct types of risk: decision risk and composite risk. We also propose a risk-centric evaluation framework, and four novel metrics, for assessing LLMs on these risks in both in-domain and out-of-domain settings. Finally, we propose a risk-adjusted calibration method called DwD for helping LLMs minimize these risks in an overall NLI architecture. Detailed experiments, using four NLI benchmarks, three baselines and two LLMs, including ChatGPT, show both the practical utility of the evaluation framework, and the efficacy of DwD in reducing decision and composite risk. For instance, when using DwD, an underlying LLM is able to address an extra 20.1% of low-risk inference tasks (but which the LLM erroneously deems high-risk without risk adjustment) and skip a further 19.8% of high-risk tasks, which would have been answered incorrectly.


title: Digitization of Weather Records of Seungjeongwon Ilgi: A Historical Weather Dynamics Dataset of the Korean Peninsula in 1623-1910

abstract: Historical weather records from Europe indicate that the Earth experienced substantial climate variability, which caused, for instance, the Little Ice Age and the global crisis in the period between the 14th and 19th centuries. However, it is still unclear how global this climate variability was because of the scarce meteorological data availability in other regions including East Asia, especially around the 17th century. In this context, Seungjeongwon Ilgi, a daily record of the Royal Secretariat of the Joseon Dynasty of Korea, is a precious source of historical meteorological records for the Korean Peninsula, as it covers 288 years of weather observations made during 1623-1910. We used the digital database of Seungjeongwon Ilgi to construct a machine-readable weather condition dataset. To this end, we extracted valid weather information from the original weather description text and compiled them into predefined weather categories. Additionally, we attempted to improve the usability of the dataset by converting the reported dates in the traditional calendar system to those in the Gregorian calendar. Finally, we outlined the promising implications of this dataset for meteorological and climatological studies, while describing the limitations of the dataset. Overall, future studies focusing on the climate and weather of the past could use this meteorological database for investigating long-term climate variability. Our datasets are publicly available at 10.5281/zenodo.8142701.


title: Burning the Adversarial Bridges: Robust Windows Malware Detection Against Binary-level Mutations

abstract: Toward robust malware detection, we explore the attack surface of existing malware detection systems. We conduct root-cause analyses of the practical binary-level black-box adversarial malware examples. Additionally, we uncover the sensitivity of volatile features within the detection engines and exhibit their exploitability. Highlighting volatile information channels within the software, we introduce three software pre-processing steps to eliminate the attack surface, namely, padding removal, software stripping, and inter-section information resetting. Further, to counter the emerging section injection attacks, we propose a graph-based section-dependent information extraction scheme for software representation. The proposed scheme leverages aggregated information within various sections in the software to enable robust malware detection and mitigate adversarial settings. Our experimental results show that traditional malware detection models are ineffective against adversarial threats. However, the attack surface can be largely reduced by eliminating the volatile information. Therefore, we propose simple-yet-effective methods to mitigate the impacts of binary manipulation attacks. Overall, our graph-based malware detection scheme can accurately detect malware with an area under the curve score of 88.32\% and a score of 88.19% under a combination of binary manipulation attacks, exhibiting the efficiency of our proposed scheme.


title: Bridging HPC and Quantum Systems using Scientific Workflows

abstract: Quantum Computers offer an intriguing challenge in modern Computer Science. With the inevitable physical limitations to Moore's Law, quantum hardware provides avenues to solve grander problems faster by utilizing Quantum Mechanical properties at subatomic scales. These futuristic devices will likely never replace traditional HPC, but rather work alongside them to perform complex tasks, utilizing the best of decades of HPC and quantum computing research. We leverage the capabilities of scientific workflows to make traditional HPC and Quantum Computers work together. To demonstrate this capability, we implemented three algorithms: Grover's Search Algorithm, Shor's Factoring Algorithm, and a 4-node Traveling Salesman Algorithm. The algorithms' implementation and generated inputs are sent from ORNL HPC to IBMQ, the algorithms run on IBMQ, and the results return. The entire process is automated as a workflow by encoding it into the Parsl parallel scripting and workflow platform.


title: Single-Subject Deep-Learning Image Reconstruction with a Neural Optimization Transfer Algorithm for PET-enabled Dual-Energy CT Imaging

abstract: Combining dual-energy computed tomography (DECT) with positron emission tomography (PET) offers many potential clinical applications but typically requires expensive hardware upgrades or increases radiation doses on PET/CT scanners due to an extra X-ray CT scan. The recent PET-enabled DECT method allows DECT imaging on PET/CT without requiring a second X-ray CT scan. It combines the already existing X-ray CT image with a 511 keV \gamma-ray CT (gCT) image reconstructed from time-of-flight PET emission data. A kernelized framework has been developed for reconstructing gCT image but this method has not fully exploited the potential of prior knowledge. Use of deep neural networks may explore the power of deep learning in this application. However, common approaches require a large database for training, which is impractical for a new imaging method like PET-enabled DECT. Here, we propose a single-subject method by using neural-network representation as a deep coefficient prior to improving gCT image reconstruction without population-based pre-training. The resulting optimization problem becomes the tomographic estimation of nonlinear neural-network parameters from gCT projection data. This complicated problem can be efficiently solved by utilizing the optimization transfer strategy with quadratic surrogates. Each iteration of the proposed neural optimization transfer algorithm includes: PET activity image update; gCT image update; and least-square neural-network learning in the gCT image domain. This algorithm is guaranteed to monotonically increase the data likelihood. Results from computer simulation, real phantom data and real patient data have demonstrated that the proposed method can significantly improve gCT image quality and consequent multi-material decomposition as compared to other methods.


title: PoseAction: Action Recognition for Patients in the Ward using Deep Learning Approaches

abstract: Real-time intelligent detection and prediction of subjects' behavior particularly their movements or actions is critical in the ward. This approach offers the advantage of reducing in-hospital care costs and improving the efficiency of healthcare workers, which is especially true for scenarios at night or during peak admission periods. Therefore, in this work, we propose using computer vision (CV) and deep learning (DL) methods for detecting subjects and recognizing their actions. We utilize OpenPose as an accurate subject detector for recognizing the positions of human subjects in the video stream. Additionally, we employ AlphAction's Asynchronous Interaction Aggregation (AIA) network to predict the actions of detected subjects. This integrated model, referred to as PoseAction, is proposed. At the same time, the proposed model is further trained to predict 12 common actions in ward areas, such as staggering, chest pain, and falling down, using medical-related video clips from the NTU RGB+D and NTU RGB+D 120 datasets. The results demonstrate that PoseAction achieves the highest classification mAP of 98.72% (IoU@0.5). Additionally, this study develops an online real-time mode for action recognition, which strongly supports the clinical translation of PoseAction. Furthermore, using OpenPose's function for recognizing face key points, we also implement face blurring, which is a practical solution to address the privacy protection concerns of patients and healthcare workers. Nevertheless, the training data for PoseAction is currently limited, particularly in terms of label diversity. Consequently, the subsequent step involves utilizing a more diverse dataset (including general actions) to train the model's parameters for improved generalization.


title: Collaborative Safety-Critical Control for Networked Dynamic Systems

abstract: As modern systems become ever more connected with complex dynamic coupling relationships, the development of safe control methods for such networked systems becomes paramount. In this paper, we define a general networked model with coupled dynamics and local control and discuss the relationship of node-level safety definitions for individual agents with local neighborhood dynamics. We define a node-level barrier function (NBF), node-level control barrier function (NCBF), and collaborative node-level barrier function (cNCBF) and provide conditions under which sets defined by these functions will be forward invariant. We use collaborative node-level barrier functions to construct a novel distributed algorithm for the safe control of collaborating network agents and provide conditions under which the algorithm is guaranteed to converge to a viable set of safe control actions for all agents or a terminally infeasible state for at least one agent. We introduce the notion of non-compliance of network neighbors as a metric of robustness for collaborative safety for a given network state and chosen barrier function hyper-parameters. We illustrate these results on a networked susceptible-infected-susceptible (SIS) model.


title: Single-shot pump-probe technique by the combination of an echelon and a grating with a time window of 109 ps

abstract: In this study, using only a single pulse, pump-probe measurement with a large time window of more than 100 ps is implemented. A commercial grating is used to encode a time window of ~ 56 ps in a single pulse; therefore, there is no need for machining customization. In addition, in this technique, the grating surface is accurately imaged, eliminating the image blur problem caused by phase differences in previous echelon-based techniques. Moreover, to make full use of the grating surface and obtain a larger time window, a simple reflection echelon is combined that matches the grating in the time window. This combination encoding strategy results in a total time window of ~ 109 ps and maintains accurate imaging of the grating surface. This time window is an order of magnitude greater than the maximum reported values of the echelon encoding strategy and the angle beam encoding strategy. To demonstrate this single-shot pump-probe technique, the two-photon absorption process of ZnSe and the excited-state absorption process of a symmetrical phenoxazinium bromine salt were studied. The possibility of further improving the experimental setup is also discussed.


title: Expedited Training of Visual Conditioned Language Generation via Redundancy Reduction

abstract: In this paper, we introduce $\text{EVL}_{\text{Gen}}$, a streamlined framework designed for the pre-training of visually conditioned language generation models with high computational demands, utilizing frozen pre-trained large language models (LLMs). The conventional approach in vision-language pre-training (VLP) typically involves a two-stage optimization process: an initial resource-intensive phase dedicated to general-purpose vision-language representation learning, focused on extracting and consolidating relevant visual features. This is followed by a subsequent phase that emphasizes end-to-end alignment between visual and linguistic modalities. Our novel one-stage, single-loss framework bypasses the computationally demanding first training stage by gradually merging similar visual tokens during training, while avoiding model collapse caused by single-stage training of BLIP-2 type models. The gradual merging process effectively condenses visual information while preserving semantic richness, resulting in rapid convergence without compromising performance. Our experimental findings demonstrate that our approach accelerates the training of vision-language models by a factor of 5 without a noticeable impact on overall performance. Furthermore, we illustrate that our models significantly narrow the performance gap to current vision-language models using only 1/10 of the data. Finally, we showcase how our image-text models can seamlessly adapt to video-conditioned language generation tasks through novel soft attentive temporal token contextualizing modules. Code is available at \url{https://github.com/yiren-jian/EVLGen}.


title: SoK: Access Control Policy Generation from High-level Natural Language Requirements

abstract: Administrator-centered access control failures can cause data breaches, putting organizations at risk of financial loss and reputation damage. Existing graphical policy configuration tools and automated policy generation frameworks attempt to help administrators configure and generate access control policies by avoiding such failures. However, graphical policy configuration tools are prone to human errors, making them unusable. On the other hand, automated policy generation frameworks are prone to erroneous predictions, making them unreliable. Therefore, to find ways to improve their usability and reliability, we conducted a Systematic Literature Review analyzing 49 publications, to identify those tools, frameworks, and their limitations. Identifying those limitations will help develop effective access control policy generation solutions while avoiding access control failures.


title: A New Dialogue Response Generation Agent for Large Language Models by Asking Questions to Detect User's Intentions

abstract: Large Language Models (LLMs), such as ChatGPT, have recently been applied to various NLP tasks due to its open-domain generation capabilities. However, there are two issues with applying LLMs to dialogue tasks. 1. During the dialogue process, users may have implicit intentions that might be overlooked by LLMs. Consequently, generated responses couldn't align with the user's intentions. 2. It is unlikely for LLMs to encompass all fields comprehensively. In certain specific domains, their knowledge may be incomplete, and LLMs cannot update the latest knowledge in real-time. To tackle these issues, we propose a framework~\emph{using LLM to \textbf{E}nhance dialogue response generation by asking questions to \textbf{D}etect user's \textbf{I}mplicit in\textbf{T}entions} (\textbf{EDIT}). Firstly, EDIT generates open questions related to the dialogue context as the potential user's intention; Then, EDIT answers those questions by interacting with LLMs and searching in domain-specific knowledge bases respectively, and use LLMs to choose the proper answers to questions as extra knowledge; Finally, EDIT enhances response generation by explicitly integrating those extra knowledge. Besides, previous question generation works only focus on asking questions with answers in context. In order to ask open questions, we construct a Context-Open-Question (COQ) dataset. On two task-oriented dialogue tasks (Wizard of Wikipedia and Holl-E), EDIT outperformed other LLMs.


title: DISTFLASHATTN: Distributed Memory-efficient Attention for Long-context LLMs Training

abstract: FlashAttention (Dao, 2023) effectively reduces the quadratic peak memory usage to linear in training transformer-based large language models (LLMs) on a single GPU. In this paper, we introduce DISTFLASHATTN, a distributed memory-efficient attention mechanism optimized for long-context LLMs training. We propose three key techniques: token-level workload balancing, overlapping key-value communication, and a rematerialization-aware gradient checkpointing algorithm. We evaluate DISTFLASHATTN on Llama-7B and variants with sequence lengths from 32K to 512K. DISTFLASHATTN achieves 8x longer sequences, 4.45 - 5.64x speedup compared to Ring Self-Attention, 2 - 8x longer sequences, 1.24 - 2.01x speedup compared to Megatron-LM with FlashAttention. It achieves 1.67x and 1.26 - 1.88x speedup compared to recent Ring Attention and DeepSpeed-Ulysses. Code is available at https://github.com/RulinShao/LightSeq.


title: Can pre-trained models assist in dataset distillation?

abstract: Dataset Distillation (DD) is a prominent technique that encapsulates knowledge from a large-scale original dataset into a small synthetic dataset for efficient training. Meanwhile, Pre-trained Models (PTMs) function as knowledge repositories, containing extensive information from the original dataset. This naturally raises a question: Can PTMs effectively transfer knowledge to synthetic datasets, guiding DD accurately? To this end, we conduct preliminary experiments, confirming the contribution of PTMs to DD. Afterwards, we systematically study different options in PTMs, including initialization parameters, model architecture, training epoch and domain knowledge, revealing that: 1) Increasing model diversity enhances the performance of synthetic datasets; 2) Sub-optimal models can also assist in DD and outperform well-trained ones in certain cases; 3) Domain-specific PTMs are not mandatory for DD, but a reasonable domain match is crucial. Finally, by selecting optimal options, we significantly improve the cross-architecture generalization over baseline DD methods. We hope our work will facilitate researchers to develop better DD techniques. Our code is available at https://github.com/yaolu-zjut/DDInterpreter.


title: Supercurrent in the presence of direct transmission and a resonant localized state

abstract: We study the current-phase relation (CPR) of an InSb-Al nanowire Josephson junction in parallel magnetic fields up to $700$\,mT. At high magnetic fields and in narrow voltage intervals of a gate under the junction, the CPR exhibits $\pi$-shifts. The supercurrent declines within these gate intervals and shows asymmetric gate voltage dependence above and below them. We detect these features sometimes also at zero magnetic field. The observed CPR properties are reproduced by a theoretical model of supercurrent transport via interference between direct transmission and a resonant localized state.


title: Passive Respiration Detection via mmWave Communication Signal Under Interference

abstract: Recent research has highlighted the detection of human respiration rate using commodity WiFi devices. Nevertheless, these devices encounter challenges in accurately discerning human respiration amidst the prevailing human motion interference encountered in daily life. To tackle this predicament, this paper introduces a passive sensing and communication system designed specifically for respiration detection in the presence of robust human motion interference. Operating within the 60.48 GHz band, the proposed system aims to detect human respiration even when confronted with substantial human motion interference within close proximity. Subsequently, a neural network is trained using the collected data by us to enable human respiration detection. The experimental results demonstrate a consistently high accuracy rate over 90\% of the human respiration detection under interference, given an adequate sensing duration. Finally, an empirical model is derived analytically to achieve the respiratory rate counting in 10 seconds.


title: A Latent Variable Approach for Non-Hierarchical Multi-Fidelity Adaptive Sampling

abstract: Multi-fidelity (MF) methods are gaining popularity for enhancing surrogate modeling and design optimization by incorporating data from various low-fidelity (LF) models. While most existing MF methods assume a fixed dataset, adaptive sampling methods that dynamically allocate resources among fidelity models can achieve higher efficiency in the exploring and exploiting the design space. However, most existing MF methods rely on the hierarchical assumption of fidelity levels or fail to capture the intercorrelation between multiple fidelity levels and utilize it to quantify the value of the future samples and navigate the adaptive sampling. To address this hurdle, we propose a framework hinged on a latent embedding for different fidelity models and the associated pre-posterior analysis to explicitly utilize their correlation for adaptive sampling. In this framework, each infill sampling iteration includes two steps: We first identify the location of interest with the greatest potential improvement using the high-fidelity (HF) model, then we search for the next sample across all fidelity levels that maximize the improvement per unit cost at the location identified in the first step. This is made possible by a single Latent Variable Gaussian Process (LVGP) model that maps different fidelity models into an interpretable latent space to capture their correlations without assuming hierarchical fidelity levels. The LVGP enables us to assess how LF sampling candidates will affect HF response with pre-posterior analysis and determine the next sample with the best benefit-to-cost ratio. Through test cases, we demonstrate that the proposed method outperforms the benchmark methods in both MF global fitting (GF) and Bayesian Optimization (BO) problems in convergence rate and robustness. Moreover, the method offers the flexibility to switch between GF and BO by simply changing the acquisition function.


title: Dynamical Architectures of S-type Transiting Planets in Binaries I: Target Selection using Hipparcos and Gaia proper motion anomalies

abstract: The effect of stellar multiplicity on planetary architecture and orbital dynamics provides an important context for exoplanet demographics. We present a volume-limited catalog up to 300 pc of 66 stars hosting planets and planet candidates from Kepler, K2 and TESS with significant Hipparcos-Gaia proper motion anomalies, which indicate the presence of companions. We assess the reliability of each transiting planet candidate using ground-based follow-up observations, and find that the TESS Objects of Interest (TOIs) with significant proper motion anomalies show nearly four times more false positives due to Eclipsing Binaries compared to TOIs with marginal proper motion anomalies. In addition, we find tentative evidence that orbital periods of planets orbiting TOIs with significant proper motion anomalies are shorter than those orbiting TOIs without significant proper motion anomalies, consistent with the scenario that stellar companions can truncate planet-forming disks. Furthermore, TOIs with significant proper motion anomalies exhibit lower Gaia differential velocities in comparison to field stars with significant proper motion anomalies, suggesting that planets are more likely to form in binary systems with low-mass substellar companions or stellar companions at wider separation. Finally, we characterize the three-dimensional architecture of LTT 1445 ABC using radial velocities, absolute astrometry from Gaia and Hipparcos, and relative astrometry from imaging. Our analysis reveals that LTT 1445 is a nearly flat system, with a mutual inclination of 2.88 deg between the orbit of BC around A and that of C around B. The coplanarity may explain why multiple planets around LTT 1445 A survive in the dynamically hostile environment of this system.


title: Efficient Creation of Ultracold Ground State $^{6}\textrm{Li}^{40}\textrm{K}$ Polar Molecules

abstract: We report the creation of ultracold ground state $^{6}\textrm{Li}^{40}\textrm{K}$ polar molecules with high efficiency. Starting from weakly-bound molecules state, stimulated Raman adiabatic passage (STIRAP) is adopted to coherently transfer the molecules to their singlet ro-vibrational ground state $|\textrm{X}^{1}\Sigma^{+},v=0,J=0>$. By employing a singlet STIRAP pathway and low-phase-noise narrow-linewidth lasers, we observed a one-way transfer efficiency of 96(4)\,\%. Held in an optical dipole trap, the lifetime of the ground-state molecules is measured to be 5.0(3)\,ms. The large permanent dipole moment of LiK is confirmed by applying a DC electric field on the molecules and performing Stark shift spectroscopy of the ground state. With recent advances in the quantum control of collisions, our work paves the way for exploring quantum many-body physics with strongly-interacting $^{6}\textrm{Li}^{40}\textrm{K}$ molecules.


title: Learning Energy Decompositions for Partial Inference of GFlowNets

abstract: This paper studies generative flow networks (GFlowNets) to sample objects from the Boltzmann energy distribution via a sequence of actions. In particular, we focus on improving GFlowNet with partial inference: training flow functions with the evaluation of the intermediate states or transitions. To this end, the recently developed forward-looking GFlowNet reparameterizes the flow functions based on evaluating the energy of intermediate states. However, such an evaluation of intermediate energies may (i) be too expensive or impossible to evaluate and (ii) even provide misleading training signals under large energy fluctuations along the sequence of actions. To resolve this issue, we propose learning energy decompositions for GFlowNets (LED-GFN). Our main idea is to (i) decompose the energy of an object into learnable potential functions defined on state transitions and (ii) reparameterize the flow functions using the potential functions. In particular, to produce informative local credits, we propose to regularize the potential to change smoothly over the sequence of actions. It is also noteworthy that training GFlowNet with our learned potential can preserve the optimal policy. We empirically verify the superiority of LED-GFN in five problems including the generation of unstructured and maximum independent sets, molecular graphs, and RNA sequences.


title: MLAgentBench: Evaluating Language Agents on Machine Learning Experimentation

abstract: A central aspect of machine learning research is experimentation, the process of designing and running experiments, analyzing the results, and iterating towards some positive outcome (e.g., improving accuracy). Could agents driven by powerful language models perform machine learning experimentation effectively? To answer this question, we introduce MLAgentBench, a suite of 13 tasks ranging from improving model performance on CIFAR-10 to recent research problems like BabyLM. For each task, an agent can perform actions like reading/writing files, executing code, and inspecting outputs. We then construct an agent that can perform ML experimentation based on ReAct framework. We benchmark agents based on Claude v1.0, Claude v2.1, Claude v3 Opus, GPT-4, GPT-4-turbo, Gemini-Pro, and Mixtral and find that a Claude v3 Opus agent is the best in terms of success rate. It can build compelling ML models over many tasks in MLAgentBench with 37.5% average success rate. Our agents also display highly interpretable plans and actions. However, the success rates vary considerably; they span from 100% on well-established older datasets to as low as 0% on recent Kaggle challenges created potentially after the underlying LM was trained. Finally, we identify several key challenges for LM-based agents such as long-term planning and reducing hallucination. Our code is released at https://github.com/snap-stanford/MLAgentBench.


title: A Two-stage Based Social Preference Recognition in Multi-Agent Autonomous Driving System

abstract: Multi-Agent Reinforcement Learning (MARL) has become a promising solution for constructing a multi-agent autonomous driving system (MADS) in complex and dense scenarios. But most methods consider agents acting selfishly, which leads to conflict behaviors. Some existing works incorporate the concept of social value orientation (SVO) to promote coordination, but they lack the knowledge of other agents' SVOs, resulting in conservative maneuvers. In this paper, we aim to tackle the mentioned problem by enabling the agents to understand other agents' SVOs. To accomplish this, we propose a two-stage system framework. Firstly, we train a policy by allowing the agents to share their ground truth SVOs to establish a coordinated traffic flow. Secondly, we develop a recognition network that estimates agents' SVOs and integrates it with the policy trained in the first stage. Experiments demonstrate that our developed method significantly improves the performance of the driving policy in MADS compared to two state-of-the-art MARL algorithms.


title: Learning Personalized Alignment for Evaluating Open-ended Text Generation

abstract: With rapid progress made in language qualities such as fluency and consistency via large language models (LLMs), there has been increasing interest in assessing alignment with diverse human preferences. Traditional metrics heavily rely on lexical similarity with human-written references and have been observed to suffer from a poor correlation with human evaluation. Furthermore, they ignore the diverse preferences of humans, a key aspect in evaluating open-ended tasks like story generation. Inspired by these challenges, we introduce an interpretable open-ended evaluation framework PerSE to assess the alignment with a specific human preference. It is tuned to deduce the specific preference from a given personal profile and evaluate the alignment between the generation and the personal preference. PerSE also explains its assessment by a detailed comment or several fine-grained scores. This enhances its interpretability, making it more suitable to tailor a personalized generation. Our 13B LLaMA-2-based PerSE shows a 15.8% increase in Kendall correlation and a 13.7% rise in accuracy on zero-shot reviewers compared to GPT-4. It also outperforms GPT-4 by 46.01% in the Kendall correlation on new domains, indicating its transferability.


title: Harish-Chandra bimodules over quantized flower quiver varieties with minimal support

abstract: We classify Harish-Chandra bimodules over the quantized flower quiver varieties with minimal support. We show that if the dimension vector is $n$, then there are $n!$ minimally supported simple Harish-Chandra bimodules for integral quantization parameters that are large enough or small enough, and there are none for other quantization parameters. The main tool used for this classification is an enhanced version of restriction functor.


title: Bangle functions are the generic basis for cluster algebras from punctured surfaces with boundary

abstract: We prove that for any possibly-punctured surface with non-empty boundary $\mathbf{\Sigma}=(\Sigma, \mathbb{M}, \mathbb{P})$, and any tagged triangulation $T$ of $\mathbf{\Sigma}$ in the sense of Fomin--Shapiro--Thurston, the coefficient-free bangle functions of Musiker--Schiffler--Williams coincide with the coefficient-free generic Caldero--Chapoton functions arising from the Jacobian algebra of the quiver with potential $(Q(T), W(T))$ associated to $T$ by Cerulli Irelli and the second author. When the set of boundary marked points $\mathbb{M}$ has at least two elements, Schr\"oer and the first two authors have shown, relying heavily on results of Mills, Muller and Qin, that the generic coefficient-free Caldero-Chapoton functions form a basis of the coefficient-free (upper) cluster algebra $\mathcal{A}(\mathbf{\Sigma})=\mathcal{U}(\mathbf{\Sigma})$. So, the set of bangle functions proposed by Musiker--Schiffler--Williams over ten years ago is indeed a basis.


title: Kinetic Modeling Analysis of Ar Addition to Atmospheric Pressure N2-H2 Plasma for Plasma-Assisted Catalytic Synthesis of NH3

abstract: Zero-dimensional kinetic modeling of atmospheric pressure Ar-N2-H2 nonthermal plasma was carried out to gain mechanistic insights into ammonia formation during plasma-assisted catalysis of ammonia synthesis. The kinetic model was developed for a coaxial dielectric barrier discharge (DBD) quartz wool-packed bed reactor operating at near room temperature using a kHz-frequency plasma source. With 30% Ar mixed in a 1:1 N2-H2 plasma at 760 Torr, we find that NH3 production is dominated by Eley-Rideal (E-R) surface reactions, which heavily involve surface NHx species derived from N and H radicals in the gas phase, while the influence of excited N2 molecules is negligible. This is contrary to the commonly proposed mechanism that excited N2 molecules created by Penning excitation of N2 by Ar (4s) and Ar(4p) plays a significant role in assisting NH3 formation. Our model shows that the enhanced NH3 formation upon Ar dilution is unlikely due to the interactions between Ar and H species, as excited Ar atoms have a weak effect on H radical formation through H2 dissociation compared to electrons. We find that excited Ar atoms contribute to 28% of the N radical production in the gas phase via N2 dissociation, while the rest is dominated by electron-impact dissociation. Furthermore, Ar species play a negligible role in the product NH3 dissociation. N2 conversion sensitivity analyses were carried out for electron density (ne) and reduced electric field (E/N), and contributions from Ar to gas-phase N radical production were quantified. The model can provide guidance on potential reasons for observing enhanced NH3 formation upon Ar dilution in N2-H2 plasmas beyond changes to the discharge characteristics.


title: Improved period variations of 32 contact binaries with rapidly decreasing periods in the Galactic Bulge

abstract: We present detailed analyses of updated eclipse timing diagrams for 32 contact binary merger candidates in the Galactic bulge. The photometric data was obtained from 2016 to 2021 using the Korea Microlensing Telescope Network (KMTNet) with the 1.6 m telescopes located at three southern sites (CTIO, SAAO, and SSO). The times of minimum lights were determined by applying the binary star model to full light curves created at half-year intervals from the observations. The orbital period variations of the binary systems were analyzed using the $O-C$ diagrams from our new timings with the others published in the literature (Hong et al.), which are based on the OGLE observations from 2001 to 2015. As results, the orbital periods and period decreasing rates of 32 binary systems were located to be in the ranges of 0.370$-$1.238 days and from $-3.0$ to $-13.1\times10^{-6}$ day yr$^{-1}$, respectively. Out of these stars, 24 systems show a combination effect of a parabola and a light travel time caused by a third body and their outer orbital periods are in the range of 9.1$-$26.5 yr, respectively. We propose that all of our merger candidates need additional monitoring observations to study a luminous red nova (LRN) progenitor.


title: Concise and Organized Perception Facilitates Reasoning in Large Language Models

abstract: Exploiting large language models (LLMs) to tackle reasoning has garnered growing attention. It still remains highly challenging to achieve satisfactory results in complex logical problems, characterized by plenty of premises within the prompt and requiring multi-hop reasoning. In particular, the reasoning capabilities of LLMs are brittle to disorder and distractibility. In this work, we first examine the mechanism from the perspective of information flow and reveal that LLMs exhibit failure patterns akin to human-like cognitive biases when dealing with disordered and irrelevant content in reasoning tasks. However, in contrast to LLMs, disordered and irrelevant content does not significantly decrease human performance, as humans have a propensity to distill the most relevant information and systematically organize their thoughts, aiding them in responding to questions. Stem from that, we further propose a novel reasoning approach named Concise and Organized Perception (COP). COP carefully analyzes the given statements to identify the most pertinent information while eliminating redundancy efficiently. It then prompts the LLMs in a more organized form that adapts to the model's inference process. By perceiving concise and organized context, the reasoning abilities of LLMs can be better elicited. Extensive experimental results on several popular logical benchmarks (ProofWriter, PrOntoQA, PrOntoQA-OOD, and FOLIO) and math benchmark (DI-GSM) show that COP significantly outperforms previous state-of-the-art methods.