title: A nonmonotone proximal quasi-Newton method for multiobjective optimization

abstract: This paper proposes a nonmonotone proximal quasi-Newton algorithm for unconstrained convex multiobjective composite optimization problems. To design the search direction, we minimize the max-scalarization of the variations of the Hessian approximations and nonsmooth terms. Subsequently, a nonmonotone line search is used to determine the step size, we allow for the decrease of a convex combination of recent function values. Under the assumption of strong convexity of the objective function, we prove that the sequence generated by this method converges to a Pareto optimal. Furthermore, based on the strong convexity, Hessian continuity and Dennis-Mor\'{e} criterion, we use a basic inequality to derive the local superlinear convergence rate of the proposed algorithm. Numerical experiments results demonstrate the feasibility and effectiveness of the proposed algorithm on a set of test problems.


title: Piezo-to-Piezo (P2P) Conversion: Simultaneous $\beta$-Phase Crystallization and Poling of Ultrathin, Transparent and Freestanding Homopolymer PVDF Films via MHz-Order Nanoelectromechanical Vibration

abstract: An unconventional yet facile low-energy method for uniquely synthesizing neat poly(vinylidene fluoride) (PVDF) films for energy harvesting applications through piezo-to-piezo (P2P) conversion is reported. In this novel concept, the nanoelectromechanical energy from a piezoelectric substrate is directly coupled into another polarizable material (i.e., PVDF) during its crystallization to produce a micron-thick film that not only exhibits strong piezoelectricity, but is also freestanding and optically transparent - properties ideal for its use for energy harvesting, but which are difficult to achieve through conventional synthesis routes. In particular, we show that the unprecedented acceleration ($\mathcal{O}$($10^{8}$ m s$^{-2}$)) associated with the nanoelectromechanical vibration in the form of surface reflected bulk waves (SRBWs) facilitates preferentially-oriented nucleation of the ferroelectric PVDF $\beta$-phase, while simultaneously aligning its dipoles to pole the material through the SRBW's intense native evanescent electric field ($\mathcal{O}$($10^{8}$ V m$^{-1}$)). The resultant neat (additive-free) homopolymer film synthesized through this low voltage method requiring only $\mathcal{O}$(10 V) - orders-of-magnitude lower than the energy-intensive conventional poling methods utilising high kV electric potentials - is shown to possess a 76% higher macroscale piezoelectric charge coefficient ($d_{33}$), together with a similar improvement in its power generation output, when compared to the gold-standard commercially-poled PVDF films of similar thicknesses.


title: CausalTime: Realistically Generated Time-series for Benchmarking of Causal Discovery

abstract: Time-series causal discovery (TSCD) is a fundamental problem of machine learning. However, existing synthetic datasets cannot properly evaluate or predict the algorithms' performance on real data. This study introduces the CausalTime pipeline to generate time-series that highly resemble the real data and with ground truth causal graphs for quantitative performance evaluation. The pipeline starts from real observations in a specific scenario and produces a matching benchmark dataset. Firstly, we harness deep neural networks along with normalizing flow to accurately capture realistic dynamics. Secondly, we extract hypothesized causal graphs by performing importance analysis on the neural network or leveraging prior knowledge. Thirdly, we derive the ground truth causal graphs by splitting the causal model into causal term, residual term, and noise term. Lastly, using the fitted network and the derived causal graph, we generate corresponding versatile time-series proper for algorithm assessment. In the experiments, we validate the fidelity of the generated data through qualitative and quantitative experiments, followed by a benchmarking of existing TSCD algorithms using these generated datasets. CausalTime offers a feasible solution to evaluating TSCD algorithms in real applications and can be generalized to a wide range of fields. For easy use of the proposed approach, we also provide a user-friendly website, hosted on www.causaltime.cc.


abstract: Part I Weakly differentiable functions Part II PDEs on varifolds 15 Sobolev spaces ... 75 16 Preliminaries ... 82 17 Maximum estimates ... 86 18 Second order flatness of Lebesgue spaces for integral varifolds with subcritical integrability of the mean curvature ... 94 19 Second order differentiability of the support of integral varifolds with critical integrability of the mean curvature ... 100 20 Harnack inequality ... 108 Part III The generalised Gauss map 21 Points of finite lower density ... 118 22 Points of infinite density ... 130 23 Area formula for the generalised Gauss map ... 137 24 A sharp lower bound on the mean curvature integral with critical power for integral varifolds ... 138 Appendix A Monotonicity identity ... 139


title: ImageNet-OOD: Deciphering Modern Out-of-Distribution Detection Algorithms

abstract: The task of out-of-distribution (OOD) detection is notoriously ill-defined. Earlier works focused on new-class detection, aiming to identify label-altering data distribution shifts, also known as "semantic shift." However, recent works argue for a focus on failure detection, expanding the OOD evaluation framework to account for label-preserving data distribution shifts, also known as "covariate shift." Intriguingly, under this new framework, complex OOD detectors that were previously considered state-of-the-art now perform similarly to, or even worse than the simple maximum softmax probability baseline. This raises the question: what are the latest OOD detectors actually detecting? Deciphering the behavior of OOD detection algorithms requires evaluation datasets that decouples semantic shift and covariate shift. To aid our investigations, we present ImageNet-OOD, a clean semantic shift dataset that minimizes the interference of covariate shift. Through comprehensive experiments, we show that OOD detectors are more sensitive to covariate shift than to semantic shift, and the benefits of recent OOD detection algorithms on semantic shift detection is minimal. Our dataset and analyses provide important insights for guiding the design of future OOD detectors.


title: Improved Algorithms for Adversarial Bandits with Unbounded Losses

abstract: We consider the Adversarial Multi-Armed Bandits (MAB) problem with unbounded losses, where the algorithms have no prior knowledge on the sizes of the losses. We present UMAB-NN and UMAB-G, two algorithms for non-negative and general unbounded loss respectively. For non-negative unbounded loss, UMAB-NN achieves the first adaptive and scale free regret bound without uniform exploration. Built up on that, we further develop UMAB-G that can learn from arbitrary unbounded loss. Our analysis reveals the asymmetry between positive and negative losses in the MAB problem and provide additional insights. We also accompany our theoretical findings with extensive empirical evaluations, showing that our algorithms consistently out-performs all existing algorithms that handles unbounded losses.


title: MinAres: An Iterative Solver for Symmetric Linear Systems

abstract: We introduce an iterative solver named MINARES for symmetric linear systems $Ax \approx b$, where $A$ is possibly singular. MINARES is based on the symmetric Lanczos process, like MINRES and MINRES-QLP, but it minimizes $\|Ar_k\|$ in each Krylov subspace rather than $\|r_k\|$, where $r_k$ is the current residual vector. When $A$ is symmetric, MINARES minimizes the same quantity $\|Ar_k\|$ as LSMR, but in more relevant Krylov subspaces, and it requires only one matrix-vector product $Av$ per iteration, whereas LSMR would need two. Our numerical experiments with MINRES-QLP and LSMR show that MINARES is a pertinent alternative on consistent symmetric systems and the most suitable Krylov method for inconsistent symmetric systems. We derive properties of MINARES from an equivalent solver named CAR that is to MINARES as CR is to MINRES, is not based on the Lanczos process, and minimizes $\|Ar_k\|$ in the same Krylov subspace as MINARES. We establish that MINARES and CAR generate monotonic $\|x_k - x_{\star}\|$, $\|x_k - x_{\star}\|_A$ and $\|r_k\|$ when $A$ is positive definite.


title: Linearization of ReLU Activation Function for Neural Network-Embedded Optimization:Optimal Day-Ahead Energy Scheduling

abstract: Neural networks have been widely applied in the power system area. They can be used for better predicting input information and modeling system performance with increased accuracy. In some applications such as battery degradation neural network-based microgrid day-ahead energy scheduling, the input features of the trained learning model are variables to be solved in optimization models that enforce limits on the output of the same learning model. This will create a neural network-embedded optimization problem; the use of nonlinear activation functions in the neural network will make such problems extremely hard to solve if not unsolvable. To address this emerging challenge, this paper investigated different methods for linearizing the nonlinear activation functions with a particular focus on the widely used rectified linear unit (ReLU) function. Four linearization methods tailored for the ReLU activation function are developed, analyzed and compared in this paper. Each method employs a set of linear constraints to replace the ReLU function, effectively linearizing the optimization problem, which can overcome the computational challenges associated with the nonlinearity of the neural network model. These proposed linearization methods provide valuable tools for effectively solving optimization problems that integrate neural network models with ReLU activation functions.


title: Triangles and Vitali sets

abstract: It is consistent relative to an inaccessible cardinal that ZF+DC holds, the hypergraph of equilateral triangles in Euclidean plane has countable chromatic number, while there is no Vitali set.


abstract: We introduce Adaptive Functional Principal Component Analysis, a novel method to capture directions of variation in functional data that exhibit sharp changes in smoothness. We first propose a new adaptive scatterplot smoothing technique that is fast and scalable, and then integrate this technique into a probabilistic FPCA framework to adaptively smooth functional principal components. Our simulation results show that our approach is better able to model functional data with sharp changes in smoothness compared to standard approaches. We are motivated by the need to identify coordinated patterns of brain activity across multiple neurons during reaching movements prompted by an auditory cue, which enables understanding of the dynamics in the brain during dexterous movement. Our proposed method captures the underlying biological mechanisms that arise in data obtained from a mouse experiment focused on voluntary reaching movements, offering more interpretable activation patterns that reflect sharp changes in neural activity following the cue. We develop accompanying publicly available software for our proposed methodology, along with implementations to reproduce our results.


title: Stability of smooth periodic travelling waves in the Dullin-Gottwald-Holm equation

abstract: The existence of smooth periodic traveling solutions in the Dullin-Gottwald-Holm (DGH) equation and the monotonicity of the period function are clarified. By introducing two suitable parameters, we show the existence of periodic travelling solutions of DGH equation in a concise way. The monotonicity of period function with respect to different variables are proved by using Chicone's criterion and the method developed by Geyer and Villadelprat. The problem of the spectral stability of smooth periodic waves in the DGH equation is discussed. Within the functional-analytic framework, we obtain a criterion for the spectral stability of smooth periodic traveling waves in DGH equation. In addition, we show the smooth periodic travelling solutions are orbitally stable under certain conditions.


title: Sampling Multimodal Distributions with the Vanilla Score: Benefits of Data-Based Initialization

abstract: There is a long history, as well as a recent explosion of interest, in statistical and generative modeling approaches based on score functions -- derivatives of the log-likelihood of a distribution. In seminal works, Hyv\"arinen proposed vanilla score matching as a way to learn distributions from data by computing an estimate of the score function of the underlying ground truth, and established connections between this method and established techniques like Contrastive Divergence and Pseudolikelihood estimation. It is by now well-known that vanilla score matching has significant difficulties learning multimodal distributions. Although there are various ways to overcome this difficulty, the following question has remained unanswered -- is there a natural way to sample multimodal distributions using just the vanilla score? Inspired by a long line of related experimental works, we prove that the Langevin diffusion with early stopping, initialized at the empirical distribution, and run on a score function estimated from data successfully generates natural multimodal distributions (mixtures of log-concave distributions).


title: Distinguishing the impact and signature of black holes from different origins in early cosmic history

abstract: We use semi-analytical models to study the effects of primordial black hole (PBH) accretion on the cosmic radiation background during the epoch of reionization ($z\gtrsim 6$). We consider PBHs floating in the intergalactic medium (IGM), and located inside haloes, where star formation can occur. For stars with a mass $\gtrsim 25 \rm\ M_{\odot}$, formed in suitable host haloes, we assume they quickly burn out and form stellar remnant black holes (SRBHs). Since SRBHs also accrete material from their surroundings, we consider them to have similar radiation feedback as PBHs in the halo environment. To estimate the background radiation level more accurately, we take into account the impact of PBHs on structure formation, allowing an improved modeling of the halo mass function. We consider the radiation feedback from a broad suite of black holes: PBHs, SRBHs, high-mass X-ray binaries (HMXBs), and supermassive black holes (SMBHs). We find that at $z\gtrsim 30$, the radiation background energy density is generated by PBHs accreting in the IGM, whereas at lower redshifts, the accretion feedback power from haloes dominates. We also analyze the total power density by modeling the accretion spectral energy distribution (SED), and break it down into select wavebands. In the UV band, we find that for $f_{\rm PBH} \lesssim 10^{-3}$, the H-ionizing and Lyman-$\alpha$ fluxes from PBH accretion feedback do not violate existing constraints on the timing of reionization, and on the effective Wouthuysen-Field coupling of the 21-cm spin temperature of neutral hydrogen to the kinetic temperature of the IGM. However, in the X-ray band, with the same abundance, PBHs contribute significantly and could account for the unresolved part of the cosmic X-ray background.


title: Coupled Cluster-Inspired Geminal Wavefunctions

abstract: Electron pairs have an illustrious history in chemistry, from powerful concepts to understanding structural stability and reactive changes, to the promise of serving as building blocks of quantitative descriptions of the electronic structure of complex molecules and materials. However, traditionally, two-electron wavefunctions (geminals), have not enjoyed the popularity and widespread use of the more standard single-particle methods. This has changed recently, with a renewed interest in the development of geminal wavefunctions as an alternative to describing strongly-correlated phenomena. Hence, there is a need to find geminal methods that are accurate, computationally-tractable, and do not demand significant input from the user (particularly, via cumbersome and often ill-behaved orbital optimization steps). Here we propose new families of geminal wavefunctions, inspired by the pair Coupled Cluster (pCCD) ansatz. We present a new hierarchy of two-electron wavefunctions that extend the one-reference orbital idea to other geminals. Moreover, we show how to incorporate single-like excitations in this framework, without leaving the quasiparticle picture. We explore the role of imposing seniority restrictions on these wavefunctions, and benchmark these new methods on model strongly-correlated systems.


title: Data Cleaning and Machine Learning: A Systematic Literature Review

abstract: Context: Machine Learning (ML) is integrated into a growing number of systems for various applications. Because the performance of an ML model is highly dependent on the quality of the data it has been trained on, there is a growing interest in approaches to detect and repair data errors (i.e., data cleaning). Researchers are also exploring how ML can be used for data cleaning; hence creating a dual relationship between ML and data cleaning. To the best of our knowledge, there is no study that comprehensively reviews this relationship. Objective: This paper's objectives are twofold. First, it aims to summarize the latest approaches for data cleaning for ML and ML for data cleaning. Second, it provides future work recommendations. Method: We conduct a systematic literature review of the papers published between 2016 and 2022 inclusively. We identify different types of data cleaning activities with and for ML: feature cleaning, label cleaning, entity matching, outlier detection, imputation, and holistic data cleaning. Results: We summarize the content of 101 papers covering various data cleaning activities and provide 24 future work recommendations. Our review highlights many promising data cleaning techniques that can be further extended. Conclusion: We believe that our review of the literature will help the community develop better approaches to clean data.


title: Exploring Counterfactual Alignment Loss towards Human-centered AI

abstract: Deep neural networks have demonstrated impressive accuracy in supervised learning tasks. However, their lack of transparency makes it hard for humans to trust their results, especially in safe-critic domains such as healthcare. To address this issue, recent explanation-guided learning approaches proposed to align the gradient-based attention map to image regions annotated by human experts, thereby obtaining an intrinsically human-centered model. However, the attention map these methods are based on may fail to causally attribute the model predictions, thus compromising their validity for alignment. To address this issue, we propose a novel human-centered framework based on counterfactual generation. In particular, we utilize the counterfactual generation's ability for causal attribution to introduce a novel loss called the CounterFactual Alignment (CF-Align) loss. This loss guarantees that the features attributed by the counterfactual generation for the classifier align with the human annotations. To optimize the proposed loss that entails a counterfactual generation with an implicit function form, we leverage the implicit function theorem for backpropagation. Our method is architecture-agnostic and, therefore can be applied to any neural network. We demonstrate the effectiveness of our method on a lung cancer diagnosis dataset, showcasing faithful alignment to humans.


title: Differentially Encoded Observation Spaces for Perceptive Reinforcement Learning

abstract: Perceptive deep reinforcement learning (DRL) has lead to many recent breakthroughs for complex AI systems leveraging image-based input data. Applications of these results range from super-human level video game agents to dexterous, physically intelligent robots. However, training these perceptive DRL-enabled systems remains incredibly compute and memory intensive, often requiring huge training datasets and large experience replay buffers. This poses a challenge for the next generation of field robots that will need to be able to learn on the edge in order to adapt to their environments. In this paper, we begin to address this issue through differentially encoded observation spaces. By reinterpreting stored image-based observations as a video, we leverage lossless differential video encoding schemes to compress the replay buffer without impacting training performance. We evaluate our approach with three state-of-the-art DRL algorithms and find that differential image encoding reduces the memory footprint by as much as 14.2x and 16.7x across tasks from the Atari 2600 benchmark and the DeepMind Control Suite (DMC) respectively. These savings also enable large-scale perceptive DRL that previously required paging between flash and RAM to be run entirely in RAM, improving the latency of DMC tasks by as much as 32%.


title: Backdiff: a diffusion model for generalized transferable protein backmapping

abstract: Coarse-grained (CG) models play a crucial role in the study of protein structures, protein thermodynamic properties, and protein conformation dynamics. Due to the information loss in the coarse-graining process, backmapping from CG to all-atom configurations is essential in many protein design and drug discovery applications when detailed atomic representations are needed for in-depth studies. Despite recent progress in data-driven backmapping approaches, devising a backmapping method that can be universally applied across various CG models and proteins remains unresolved. In this work, we propose BackDiff, a new generative model designed to achieve generalization and reliability in the protein backmapping problem. BackDiff leverages the conditional score-based diffusion model with geometric representations. Since different CG models can contain different coarse-grained sites which include selected atoms (CG atoms) and simple CG auxiliary functions of atomistic coordinates (CG auxiliary variables), we design a self-supervised training framework to adapt to different CG atoms, and constrain the diffusion sampling paths with arbitrary CG auxiliary variables as conditions. Our method facilitates end-to-end training and allows efficient sampling across different proteins and diverse CG models without the need for retraining. Comprehensive experiments over multiple popular CG models demonstrate BackDiff's superior performance to existing state-of-the-art approaches, and generalization and flexibility that these approaches cannot achieve. A pretrained BackDiff model can offer a convenient yet reliable plug-and-play solution for protein researchers, enabling them to investigate further from their own CG models.


title: How Over-Parameterization Slows Down Gradient Descent in Matrix Sensing: The Curses of Symmetry and Initialization

abstract: This paper rigorously shows how over-parameterization changes the convergence behaviors of gradient descent (GD) for the matrix sensing problem, where the goal is to recover an unknown low-rank ground-truth matrix from near-isotropic linear measurements. First, we consider the symmetric setting with the symmetric parameterization where $M^* \in \mathbb{R}^{n \times n}$ is a positive semi-definite unknown matrix of rank $r \ll n$, and one uses a symmetric parameterization $XX^\top$ to learn $M^*$. Here $X \in \mathbb{R}^{n \times k}$ with $k > r$ is the factor matrix. We give a novel $\Omega (1/T^2)$ lower bound of randomly initialized GD for the over-parameterized case ($k >r$) where $T$ is the number of iterations. This is in stark contrast to the exact-parameterization scenario ($k=r$) where the convergence rate is $\exp (-\Omega (T))$. Next, we study asymmetric setting where $M^* \in \mathbb{R}^{n_1 \times n_2}$ is the unknown matrix of rank $r \ll \min\{n_1,n_2\}$, and one uses an asymmetric parameterization $FG^\top$ to learn $M^*$ where $F \in \mathbb{R}^{n_1 \times k}$ and $G \in \mathbb{R}^{n_2 \times k}$. Building on prior work, we give a global exact convergence result of randomly initialized GD for the exact-parameterization case ($k=r$) with an $\exp (-\Omega(T))$ rate. Furthermore, we give the first global exact convergence result for the over-parameterization case ($k>r$) with an $\exp(-\Omega(\alpha^2 T))$ rate where $\alpha$ is the initialization scale. This linear convergence result in the over-parameterization case is especially significant because one can apply the asymmetric parameterization to the symmetric setting to speed up from $\Omega (1/T^2)$ to linear convergence. On the other hand, we propose a novel method that only modifies one step of GD and obtains a convergence rate independent of $\alpha$, recovering the rate in the exact-parameterization case.


title: A simple connection from loss flatness to compressed representations in neural networks

abstract: The generalization capacity of deep neural networks has been studied in a variety of ways, including at least two distinct categories of approaches: one based on the shape of the loss landscape in parameter space, and the other based on the structure of the representation manifold in feature space (that is, in the space of unit activities). Although these two approaches are related, they are rarely studied together explicitly. Here, we present an analysis that bridges this gap. We show that in the final phase of learning in deep neural networks, the compression of the manifold of neural representations correlates with the flatness of the loss around the minima explored by SGD. This correlation is predicted by a relatively simple mathematical relationship: a flatter loss corresponds to a lower upper bound on the compression metrics of neural representations. Our work builds upon the linear stability insight by Ma and Ying, deriving inequalities between various compression metrics and quantities involving sharpness. Empirically, our derived inequality predicts a consistently positive correlation between representation compression and loss sharpness in multiple experimental settings. Overall, we advance a dual perspective on generalization in neural networks in both parameter and feature space.


title: Hypergraph coverings and Ramanujan Hypergraphs

abstract: In this paper we investigate Ramanujan hypergraphs by using hypergraph coverings. We first show that the spectrum of a $k$-fold covering $\bar{H}$ of a connected hypergraph $H$ contains the spectrum of $H$, and that it is the union of the spectrum of $H$ and the spectrum of an incidence-signed hypergraph with $H$ as underlying hypergraph if $k=2$, which generalizes Bilu-Linial result on graph coverings. We give a lower bound for the second largest eigenvalue of a $d$-regular hypergraph by universal cover, which generalizes Alon-Boppana bound on $d$-regular graphs and Feng-Li bound on $(d,r)$-regular hypergraphs. By using interlacing family of polynomials, we prove that every $(d,r)$-regular hypergraph has a right-sided Ramanujan $2$-covering, and has a left-sided Ramanujan $2$-covering if the roots of the matching polynomial of its incident graph satisfy some condition. By Ramanujan $2$-coverings, we prove the existence of some families of infinite many left-sided or right-sided $(d,r)$-regular Ramanujan hypergraphs under certain conditions on $d$ and $r$.


title: SnB Collaborative Visualization

abstract: We describe a system for visualization and editing of data in a computational chemistry environment. The system is a collaborative tool allowing researchers using virtual reality and/or desktop computer displays to work together on results of the Shake-and-Bake structure determination application.


title: Power sum elements in the $G_2$ skein algebra

abstract: We study the skein algebras of surfaces associated to the exceptional Lie group $G_2,$ using Kuperberg webs. We identify two 2-variable polynomials, $P_n(x,y)$ and $Q_n(x,y),$ and use threading operations along knots to construct a family of central elements in the $G_2$ skein algebra of a surface, $\mathcal{S}_q^{G_2}(\Sigma),$ when the quantum parameter $q$ is a $2n\text{-th}$ root of unity. We verify these elements are central using elementary skein-theoretic arguments. We also obtain a result about the uniqueness of the so-called transparent polynomials $P_n$ and $Q_n.$ Our methods involve a detailed study of the skein modules of the annulus and the twice-marked annulus.


title: A mobile digital device proficiency performance test for cognitive clinical research

abstract: Mobile device proficiency is increasingly important for everyday living, including to deliver healthcare services. Human-device interactions represent a potential in cognitive neurology and aging research. Although traditional pen-and-paper evaluations serve as valuable tools within public health strategies for population-scale cognitive assessments, digital devices could amplify cognitive assessment. However, even person-centered studies often fail to incorporate measures of mobile device proficiency and research with digital mobile technology frequently neglects these evaluations. Besides that, cognitive screening, a fundamental part of brain health evaluation and a widely accepted strategy to identify high-risk individuals vulnerable to cognitive impairment and dementia, has research using digital devices for older adults in need for standardization. To address this shortfall, the DigiTAU collaborative and interdisciplinary project is creating refined methodological parameters for the investigation of digital biomarkers. With careful consideration of cognitive design elements, here we describe the open-source and performance-based Mobile Device Abilities Test (MDAT), a simple, low-cost, and reproductible open-sourced test framework. This result was achieved with a cross-sectional study population sample of 101 low and middle-income subjects aged 20 to 79 years old. Partial least squares structural equation modeling (PLS-SEM) was used to assess the measurement of the construct. It was possible to achieve a reliable method with internal consistency, good content validity related to digital competences, and that does not have much interference with auto-perceived global functional disability, health self-perception, and motor dexterity. Limitations for this method are discussed and paths to improve and establish better standards are highlighted.


title: STAMP: Differentiable Task and Motion Planning via Stein Variational Gradient Descent

abstract: Planning for many manipulation tasks, such as using tools or assembling parts, often requires both symbolic and geometric reasoning. Task and Motion Planning (TAMP) algorithms typically solve these problems by conducting a tree search over high-level task sequences while checking for kinematic and dynamic feasibility. This can be inefficient as the width of the tree can grow exponentially with the number of possible actions and objects. In this paper, we propose a novel approach to TAMP that relaxes discrete-and-continuous TAMP problems into inference problems on a continuous domain. Our method, Stein Task and Motion Planning (STAMP) subsequently solves this new problem using a gradient-based variational inference algorithm called Stein Variational Gradient Descent, by obtaining gradients from a parallelized differentiable physics simulator. By introducing relaxations to the discrete variables, leveraging parallelization, and approaching TAMP as an Bayesian inference problem, our method is able to efficiently find multiple diverse plans in a single optimization run. We demonstrate our method on two TAMP problems and benchmark them against existing TAMP baselines.


title: Some remarks on projectile motion with a linear resistance force

abstract: In this article we revisit the projectile motion assuming a retarding force proportional to the velocity, $\vec{F_r} = -mk\vec{V}$. We obtain an analytical expression for the set of maxima of the trajectories, in Cartesian coordinates, without using the Lambert $W$ function. Also, we investigate the effect of the parameter $k$ on the radial distance of the projectile showing that the radial distance oscillates from a certain critical launch angle and find an approximate expression for it. In our analysis, we consider the impact of the parameter $k$ in the kinetic energy, the potential energy, the total energy and the rate of energy loss, and in the phase space. Our results can be included in an intermediate-level classical mechanics course.


title: SEA: Sparse Linear Attention with Estimated Attention Mask

abstract: The transformer architecture has driven breakthroughs in recent years on tasks which require modeling pairwise relationships between sequential elements, as is the case in natural language understanding. However, long seqeuences pose a problem due to the quadratic complexity of the attention operation. Previous research has aimed to lower the complexity by sparsifying or linearly approximating the attention matrix. Yet, these approaches cannot straightforwardly distill knowledge from a teacher's attention matrix and often require complete retraining from scratch. Furthermore, previous sparse and linear approaches lose interpretability if they cannot produce full attention matrices. To address these challenges, we propose SEA: Sparse linear attention with an Estimated Attention mask. SEA estimates the attention matrix with linear complexity via kernel-based linear attention, then subsequently creates a sparse attention matrix with a top-k selection to perform a sparse attention operation. For language modeling tasks (Wikitext2), previous linear and sparse attention methods show roughly two-fold worse perplexity scores over the quadratic OPT-1.3B baseline, while SEA achieves better perplexity than OPT-1.3B, using roughly half the memory of OPT-1.3B, providing interpretable attention matrix. We believe that our work will have a large practical impact, as it opens the possibility of running large transformers on resource-limited devices with less memory.


title: Revisiting the Scalar Leptoquark ($S_1$) Model with the Updated Leptonic Constraints

abstract: The Standard Model, if extended to the energy scale of $\mathcal{O}(1)$ TeV, the known particle spectrum could be augmented with a scalar leptoquark. Within this minimally extended framework, explaining the anomalous magnetic moment and electric dipole moment simultaneously for the three lepton generations over a parameter space consistent with all the lepton flavor violating bounds is possible. Such a model can be tested or falsified through the collider search experiments and/or by probing the low-energy lepton phenomena. This work studies the current prospects of the model in the presence of recent experimental updates for the leptonic observables.


title: HallE-Control: Controlling Object Hallucination in Large Multimodal Models

abstract: Current Large Multimodal Models (LMMs) achieve remarkable progress, yet there remains significant uncertainty regarding their ability to accurately apprehend visual details, that is, in performing detailed captioning. To address this, we introduce $\textit{CCEval}$, a GPT-4 assisted evaluation method for detailed captioning. Interestingly, while LMMs demonstrate minimal object existence hallucination in existing VQA benchmarks, our proposed evaluation reveals continued susceptibility to such hallucinations. In this paper, we make the first attempt to investigate such hallucination from different aspects, including image resolution, the language decoder size, and instruction data amount, quality, granularity. Our findings underscore the unwarranted inference when the language description includes details at a finer object granularity than what the vision module can ground or verify, thus inducing hallucination. To control such hallucinations, we further attribute the reliability of captioning to contextual knowledge (involving only contextually grounded objects) and parametric knowledge (containing inferred objects by the model). Thus, we introduce $\textit{HallE-Control}$, a controllable LMM in terms of $\textbf{Hall}$ucination in object $\textbf{E}$xistence. HallE-Control can condition the captioning to shift between (i) exclusively depicting contextual knowledge for grounded objects and (ii) blending it with parametric knowledge to imagine inferred objects. Our method reduces hallucination by 44% compared to LLaVA$_{7B}$ and maintains the object coverage.


title: Social Optimal Freshness in Multi-Source, Multi-Channel Systems via MDP

abstract: Many systems necessitate frequent and consistent updates of a specific information. Often this information is updated regularly, where an old packet becomes completely obsolete in the presence of a new packet. In this context, we consider a system with multiple sources, each equipped with a storage buffer of size one, communicating to a common destination via d orthogonal channels. In each slot, the packets arrive at each source with certain probability and occupy the buffer (by discarding the old packet if any), and each transfer (to the destination) is successful with certain other probability. Thus in any slot, there are two (Age of Information) AoI-measures for each source: one corresponding to the information at the source itself and the other corresponding to the information of the same source available at the destination; some sources may not even have the packet to transmit. The aim of the controller at the destination is to maintain the freshness of information of all the sources, to the best extent possible -- it aims to design an optimal scheduling policy that assigns in each slot, a subset of sources with packets (at maximum d) for transmission. This is achieved using an appropriate Markov Decision Process (MDP) framework, where the objective function is the sum of Average AoIs (AAoI) of all the sources. We derive a very simple stationary policy that is epsilon-optimal -- in any slot, order the sources with packets in the decreasing order of the differences in AoI at the destination and the source and choose the top sources for transmission. With moderate number of sources (less than 30), the AAoI reduces in the range of 30-90%.


title: Design and Stability of Angle based Feedback Control in Power Systems: A Negative-Imaginary Approach

abstract: This paper considers a power transmission network characterized by interconnected nonlinear swing dynamics on generator buses. At the steady state, frequencies across different buses synchronize to a common nominal value such as $50$Hz or $60$Hz, and power flows on transmission lines are within steady-state envelopes. We assume that fast measurements of generator rotor angles are available. Our approach to frequency and angle control centers on equipping generator buses with large-scale batteries that are controllable on a fast timescale. We link angle based feedback linearization control with negative-imaginary systems theory. Angle based feedback controllers are designed using large-scale batteries as actuators and can be implemented in a distributed manner incorporating local information. Our analysis demonstrates the internal stability of the interconnection between the power transmission network and the angle based feedback controllers. This internal stability underscores the benefits of achieving frequency synchronization and preserving steady-state power flows within network envelopes through the use of feedback controllers. Our approach will enable transmission lines to be operated at maximum power capacity since stability robustness is ensured by the use of feedback controllers rather than conservative criteria such as the equal area criterion. By means of numerical simulations, we illustrate our results.


title: J0107a: A Barred Spiral Dusty Star-forming Galaxy at $z=2.467$

abstract: Dusty Star-Forming Galaxies (DSFGs) are amongst the most massive and active star-forming galaxies during the cosmic noon. Theoretical studies have proposed various formation mechanisms of DSFGs, including major merger-driven starbursts and secular star-forming disks. Here, we report J0107a, a bright ($\sim8$ mJy at observed-frame 888 $\mu$m) DSFG at $z=2.467$ that appears to be a gas-rich massive disk and might be an extreme case of the secular disk scenario. J0107a has a stellar mass $M_\star\sim5\times10^{11}M_\odot$, molecular gas mass $M_\mathrm{mol}\sim(1\textendash6)\times10^{11}M_\odot$, and a star formation rate (SFR) of $\sim500M_\odot$ yr$^{-1}$. J0107a does not have a gas-rich companion. The rest-frame 1.28 $\mu$m JWST NIRCam image of J0107a shows a grand-design spiral with a prominent stellar bar extending $\sim15$ kpc. ALMA band 7 continuum map reveals that the dust emission originates from both the central starburst and the stellar bar. 3D disk modeling of the CO(4-3) emission line indicates a dynamically cold disk with rotation-to-dispersion ratio $V_\mathrm{max}/\sigma\sim8$. The results suggest a bright DSFG may have a non-merger origin, and its vigorous star formation may be triggered by bar and/or rapid gas inflow.


title: Can large language models provide useful feedback on research papers? A large-scale empirical analysis

abstract: Expert feedback lays the foundation of rigorous research. However, the rapid growth of scholarly production and intricate knowledge specialization challenge the conventional scientific feedback mechanisms. High-quality peer reviews are increasingly difficult to obtain. Researchers who are more junior or from under-resourced settings have especially hard times getting timely feedback. With the breakthrough of large language models (LLM) such as GPT-4, there is growing interest in using LLMs to generate scientific feedback on research manuscripts. However, the utility of LLM-generated feedback has not been systematically studied. To address this gap, we created an automated pipeline using GPT-4 to provide comments on the full PDFs of scientific papers. We evaluated the quality of GPT-4's feedback through two large-scale studies. We first quantitatively compared GPT-4's generated feedback with human peer reviewer feedback in 15 Nature family journals (3,096 papers in total) and the ICLR machine learning conference (1,709 papers). The overlap in the points raised by GPT-4 and by human reviewers (average overlap 30.85% for Nature journals, 39.23% for ICLR) is comparable to the overlap between two human reviewers (average overlap 28.58% for Nature journals, 35.25% for ICLR). The overlap between GPT-4 and human reviewers is larger for the weaker papers. We then conducted a prospective user study with 308 researchers from 110 US institutions in the field of AI and computational biology to understand how researchers perceive feedback generated by our GPT-4 system on their own papers. Overall, more than half (57.4%) of the users found GPT-4 generated feedback helpful/very helpful and 82.4% found it more beneficial than feedback from at least some human reviewers. While our findings show that LLM-generated feedback can help researchers, we also identify several limitations.


title: On Squared-Variable Formulations

abstract: We revisit a formulation technique for inequality constrained optimization problems that has been known for decades: the substitution of squared variables for nonnegative variables. Using this technique, inequality constraints are converted to equality constraints via the introduction of a squared-slack variable. Such formulations have the superficial advantage that inequality constraints can be dispensed with altogether. But there are clear disadvantages, not least being that first-order optimal points for the squared-variable reformulation may not correspond to first-order optimal points for the original problem, because the Lagrange multipliers may have the wrong sign. Extending previous results, this paper shows that points satisfying approximate second-order optimality conditions for the squared-variable reformulation also, under certain conditions, satisfy approximate second-order optimality conditions for the original formulation, and vice versa. Such results allow us to adapt complexity analysis of methods for equality constrained optimization to account for inequality constraints. On the algorithmic side, we examine squared-variable formulations for several interesting problem classes, including bound-constrained quadratic programming and linear programming. We show that algorithms built on these formulations are surprisingly competitive with standard methods. For linear programming, we examine the relationship between the squared-variable approach and primal-dual interior-point methods.


title: Swarmalators with higher harmonic coupling: Clustering and vacillating

abstract: We study the dynamics of a swarmalator model with higher harmonic phase coupling. We analyze stability, bifurcation and structural properties of several novel attracting states, including the formation of spatial clusters with distinct phases, and single spatial clusters with a small number of distinct phases. We use mean-field (centroid) dynamics to analytically determine inter-cluster distance. We also find states with two large clusters along with a small number of swarmalators that are trapped between the two clusters and vacillate (waver) between them. In the case of a single vacillator we use a mean-field reduction to reduce the dynamics to two-dimensions, which enables a detailed bifurcation analysis. We show excellent agreement between our reduced two-dimensional model and the dynamics and bifurcations of the full swarmalator model.


title: Combinatorics and Representation Theory of Special Cases of Chern Plethysm

abstract: Chern plethysm (introduced by Billey, Rhoades, and Tewari) is a geometric way to produce Schur positive symmetric polynomials. We present combinatorial interpretations for the Schur expansions of special cases of Chern plethysm. We also exhibit a symmetric group module whose Frobenius characteristic is (a symmetric function analog of) one of these cases, generalizing a result of Reiner and Webb.


title: Higher-group symmetry in lattice gauge theories with restricted topological sectors

abstract: In this paper, we give a brief overview of generalized symmetries from the point of view of the lattice regularization as a fully regularized framework. At first, we illustrate the generalization of 't~Hooft anomaly matching for higher-form symmetries. Furthermore the main interest goes to the higher-group symmetry. In particular, we find that the so-called $4$-group appears in the lattice Yang--Mills theory under modification of instanton sum.


title: $t$-Gauduchon Ricci-flat metrics on non-K\"{a}hler Calabi-Yau manifolds

abstract: We construct new examples of $t$-Gauduchon Ricci-flat metrics, for all $t<1$, on compact non-K\"{a}hler Calabi-Yau manifolds defined by certain principal torus bundles over rational homogeneous varieties with Picard number $\varrho(X) > 1$. As an application, we provide a detailed description of new examples of Strominger-Bismut Ricci-flat Hermitian metrics, Lichnerowicz Ricci-flat Hermitian metrics, and balanced Hermitian metrics on principal $T^{2}$-bundles over the Fano threefold ${\mathbb{P}}(T_{{\mathbb{P}^{2}}})$.


title: Charge Transport Through DNA with Energy-Dependent Decoherence

abstract: Modeling charge transport in DNA is essential to understand and control the electrical properties and develop DNA-based nanoelectronics. DNA is a fluctuating molecule that exists in a solvent environment, which makes the electron susceptible to decoherence. While knowledge of the Hamiltonian responsible for decoherence will provide a microscopic description, the interactions are complex and methods to calculate decoherence are unclear. One prominent phenomenological model to include decoherence is through fictitious probes that depend on spatially variant scattering rates. However, the built-in energy-independence of the decoherence (E-indep) model overestimates the transmission in the bandgap and washes out distinct features inside the valence or conduction bands. In this study, we introduce a related model where the decoherence rate is energy-dependent (E-dep). This decoherence rate is maximum at energy levels and decays away from these energies. Our results show that the E-dep model allows for exponential transmission decay with the DNA length and maintains features within the bands' transmission spectra. We further demonstrate that we can obtain DNA conductance values within the experimental range. The new model can help study and design nanoelectronics devices that utilize weakly-coupled molecular structures such as DNA.


title: Complex magnetic interactions and critical behavior analysis in quaternary CoFeV$_{0.8}$Mn$_{0.2}$Si Heusler alloy

abstract: We investigate the magnetic behavior and critical exponents of quaternary CoFeV$_{0.8}$Mn$_{0.2}$Si Heusler alloy to understand the interactions across the Curie temperature ($T_{\rm C}$). The Rietveld refinement of the x-ray diffraction pattern with the space group F$\bar{4}$3m confirms a single-phase cubic Y-type crystal structure. The magnetic susceptibility $\chi (T)$ data show a ferromagnetic nature with a second-order phase transition from paramagnetic to ferromagnetic at $446\pm1$~K. The saturation magnetization at 5~K is determined to be 2.2~$\mu_B$/f.u., which found to be close to the Slater--Pauling rule and indicates its half-metallic nature. The values of asymptotic critical exponents ($\beta$, $\gamma$, and $\delta$) and the $T_{\rm C}$ are extracted through detailed analytical analysis including the Modified Arrott plot, the Kouvel-Fisher (K--F) method, and the Widom scaling relation. Interestingly, the estimated values of $\beta$ = 0.369 and $\gamma$ = 1.445 closely approximate the theoretical values of the 3D Heisenberg model and second-order thermodynamic phase transition across the $T_{\rm C}$. The obtained exponents lead to the collapse of renormalized isotherms, represented by the relationship between the magnetization (m) and the applied magnetic field (h), into two distinct branches above and below the $T_{\rm C}$, which validates the reliability of the analysis. Furthermore, these exponents suggest that the spin interaction follows a decay pattern of $J(r) \sim r^{-4.99}$, indicating a short-range magnetic ordering, akin to the itinerant-electron 3D Heisenberg model.


title: Online POMDP Planning with Anytime Deterministic Guarantees

abstract: Autonomous agents operating in real-world scenarios frequently encounter uncertainty and make decisions based on incomplete information. Planning under uncertainty can be mathematically formalized using partially observable Markov decision processes (POMDPs). However, finding an optimal plan for POMDPs can be computationally expensive and is feasible only for small tasks. In recent years, approximate algorithms, such as tree search and sample-based methodologies, have emerged as state-of-the-art POMDP solvers for larger problems. Despite their effectiveness, these algorithms offer only probabilistic and often asymptotic guarantees toward the optimal solution due to their dependence on sampling. To address these limitations, we derive a deterministic relationship between a simplified solution that is easier to obtain and the theoretically optimal one. First, we derive bounds for selecting a subset of the observations to branch from while computing a complete belief at each posterior node. Then, since a complete belief update may be computationally demanding, we extend the bounds to support reduction of both the state and the observation spaces. We demonstrate how our guarantees can be integrated with existing state-of-the-art solvers that sample a subset of states and observations. As a result, the returned solution holds deterministic bounds relative to the optimal policy. Lastly, we substantiate our findings with supporting experimental results.


title: Bonds and Bytes: the Odyssey of Structural Biology

abstract: Characterizing structural and dynamic properties of proteins and large macromolecular assemblies is crucial to understand the molecular mechanisms underlying biological functions. In the field of Structural Biology, no single method comprehensively reveals the behavior of biological systems across various spatio-temporal scales. Instead, we have a versatile toolkit of techniques, each contributing a piece to the overall puzzle. Integrative Structural Biology combines different techniques to create accurate and precise multi-scale models that expand our understanding of complex biological systems. This review outlines recent advancements in computational and experimental methods in Structural Biology, with special focus on recent Artificial Intelligence techniques, emphasizes integrative approaches that combine different types of data for precise spatio-temporal modeling, and provides an outlook into future directions of this field.


title: On regular sets in Cayley graphs

abstract: Let $\Ga = (V, E)$ be a graph and $a, b$ nonnegative integers. An $(a, b)$-regular set in $\Ga$ is a nonempty proper subset $D$ of $V$ such that every vertex in $D$ has exactly $a$ neighbours in $D$ and every vertex in $V \setminus D$ has exactly $b$ neighbours in $D$. A $(0,1)$-regular set is called a perfect code, an efficient dominating set, or an independent perfect dominating set. A subset $D$ of a group $G$ is called an $(a,b)$-regular set of $G$ if it is an $(a, b)$-regular set in some Cayley graph of $G$, and an $(a, b)$-regular set in a Cayley graph of $G$ is called a subgroup $(a, b)$-regular set if it is also a subgroup of $G$. In this paper we study $(a, b)$-regular sets in Cayley graphs with a focus on $(0, k)$-regular sets, where $k \ge 1$ is an integer. Among other things we determine when a non-trivial proper normal subgroup of a group is a $(0, k)$-regular set of the group. We also determine all subgroup $(0, k)$-regular sets of dihedral groups and generalized quaternion groups. We obtain necessary and sufficient conditions for a hypercube or the Cartesian product of $n$ copies of the cycle of length $p$ to admit $(0, k)$-regular sets, where $p$ is an odd prime. Our results generalize several known results from perfect codes to $(0, k)$-regular sets.


title: GNNX-BENCH: Unravelling the Utility of Perturbation-based GNN Explainers through In-depth Benchmarking

abstract: Numerous explainability methods have been proposed to shed light on the inner workings of GNNs. Despite the inclusion of empirical evaluations in all the proposed algorithms, the interrogative aspects of these evaluations lack diversity. As a result, various facets of explainability pertaining to GNNs, such as a comparative analysis of counterfactual reasoners, their stability to variational factors such as different GNN architectures, noise, stochasticity in non-convex loss surfaces, feasibility amidst domain constraints, and so forth, have yet to be formally investigated. Motivated by this need, we present a benchmarking study on perturbation-based explainability methods for GNNs, aiming to systematically evaluate and compare a wide range of explainability techniques. Among the key findings of our study, we identify the Pareto-optimal methods that exhibit superior efficacy and stability in the presence of noise. Nonetheless, our study reveals that all algorithms are affected by stability issues when faced with noisy data. Furthermore, we have established that the current generation of counterfactual explainers often fails to provide feasible recourses due to violations of topological constraints encoded by domain-specific considerations. Overall, this benchmarking study empowers stakeholders in the field of GNNs with a comprehensive understanding of the state-of-the-art explainability methods, potential research problems for further enhancement, and the implications of their application in real-world scenarios.


title: TempoNet: Empowering long-term Knee Joint Angle Prediction with Dynamic Temporal Attention in Exoskeleton Control

abstract: In the realm of exoskeleton control, achieving precise control poses challenges due to the mechanical delay of exoskeletons. To address this, incorporating future gait trajectories as feed-forward input has been proposed. However, existing deep learning models for gait prediction mainly focus on short-term predictions, leaving the long-term performance of these models relatively unexplored. In this study, we present TempoNet, a novel model specifically designed for precise knee joint angle prediction. By harnessing dynamic temporal attention within the Transformer-based architecture, TempoNet surpasses existing models in forecasting knee joint angles over extended time horizons. Notably, our model achieves a remarkable reduction of 10\% to 185\% in Mean Absolute Error (MAE) for 100 ms ahead forecasting compared to other transformer-based models, demonstrating its effectiveness. Furthermore, TempoNet exhibits further reliability and superiority over the baseline Transformer model, outperforming it by 14\% in MAE for the 200 ms prediction horizon. These findings highlight the efficacy of TempoNet in accurately predicting knee joint angles and emphasize the importance of incorporating dynamic temporal attention. TempoNet's capability to enhance knee joint angle prediction accuracy opens up possibilities for precise control, improved rehabilitation outcomes, advanced sports performance analysis, and deeper insights into biomechanical research. Code implementation for the TempoNet model can be found in the GitHub repository: https://github.com/LyesSaadSaoud/TempoNet.


title: LILAC: Log Parsing using LLMs with Adaptive Parsing Cache

abstract: Log parsing transforms log messages into structured formats, serving as the prerequisite step for various log analysis tasks. Although a variety of log parsing approaches have been proposed, their performance on complicated log data remains compromised due to the use of human-crafted rules or learning-based models with limited training data. The recent emergence of powerful large language models (LLMs) demonstrates their vast pre-trained knowledge related to code and logging, making it promising to apply LLMs for log parsing. However, their lack of specialized log parsing capabilities currently hinders their accuracy in parsing. Moreover, the inherent inconsistent answers, as well as the substantial overhead, prevent the practical adoption of LLM-based log parsing. To address these challenges, we propose LILAC, the first practical log parsing framework using LLMs with adaptive parsing cache. To facilitate accurate and robust log parsing, LILAC leverages the in-context learning (ICL) capability of the LLM by performing a hierarchical candidate sampling algorithm and selecting high-quality demonstrations. Furthermore, LILAC incorporates a novel component, an adaptive parsing cache, to store and refine the templates generated by the LLM. It helps mitigate LLM's inefficiency issue by enabling rapid retrieval of previously processed log templates. In this process, LILAC adaptively updates the templates within the parsing cache to ensure the consistency of parsed results. The extensive evaluation on public large-scale datasets shows that LILAC outperforms state-of-the-art methods by 69.5% in terms of the average F1 score of template accuracy. In addition, LILAC reduces the query times to LLMs by several orders of magnitude, achieving a comparable efficiency to the fastest baseline.


title: On the influence of shock-cloud interactions on the nonthermal X-ray emission from the supernova remnant RCW 86

abstract: It is an open issue how the surrounding environment of supernova remnant shocks affect nonthermal X-rays from accelerated electrons, with or without interacting dense material. We have conducted spatially resolved X-ray spectroscopy of the shock-cloud interacting region of RCW 86 with XMM-Newton. It is found that bright soft X-ray filaments surround the dense cloud observed with 12CO and HI emission lines. These filaments are brighter in thermal X-ray emission, and fainter and possibly softer in synchrotron X-rays, compared to those without interaction. Our results show that the shock decelerates due to the interaction with clouds, which results in an enhancements of thermal X-ray emission. This could possibly also explain the softer X-ray synchrotron component, because it implies that those shocks that move through a low density environment, and therefore decelerate much less, can be more efficient accelerators. This is similar to SN 1006 and Tycho, and is in contrast to RX J1713.7-3946. This difference among remnants may be due to the clumpiness of dense material interacting with the shock, which should be examined with future observations.


title: Large Language Models Cannot Self-Correct Reasoning Yet

abstract: Large Language Models (LLMs) have emerged as a groundbreaking technology with their unparalleled text generation capabilities across various applications. Nevertheless, concerns persist regarding the accuracy and appropriateness of their generated content. A contemporary methodology, self-correction, has been proposed as a remedy to these issues. Building upon this premise, this paper critically examines the role and efficacy of self-correction within LLMs, shedding light on its true potential and limitations. Central to our investigation is the notion of intrinsic self-correction, whereby an LLM attempts to correct its initial responses based solely on its inherent capabilities, without the crutch of external feedback. In the context of reasoning, our research indicates that LLMs struggle to self-correct their responses without external feedback, and at times, their performance even degrades after self-correction. Drawing from these insights, we offer suggestions for future research and practical applications in this field.


title: SMRD: SURE-based Robust MRI Reconstruction with Diffusion Models

abstract: Diffusion models have recently gained popularity for accelerated MRI reconstruction due to their high sample quality. They can effectively serve as rich data priors while incorporating the forward model flexibly at inference time, and they have been shown to be more robust than unrolled methods under distribution shifts. However, diffusion models require careful tuning of inference hyperparameters on a validation set and are still sensitive to distribution shifts during testing. To address these challenges, we introduce SURE-based MRI Reconstruction with Diffusion models (SMRD), a method that performs test-time hyperparameter tuning to enhance robustness during testing. SMRD uses Stein's Unbiased Risk Estimator (SURE) to estimate the mean squared error of the reconstruction during testing. SURE is then used to automatically tune the inference hyperparameters and to set an early stopping criterion without the need for validation tuning. To the best of our knowledge, SMRD is the first to incorporate SURE into the sampling stage of diffusion models for automatic hyperparameter selection. SMRD outperforms diffusion model baselines on various measurement noise levels, acceleration factors, and anatomies, achieving a PSNR improvement of up to 6 dB under measurement noise. The code is publicly available at https://github.com/NVlabs/SMRD .


title: A Bayesian approach to estimate the completeness of death registration

abstract: Civil registration and vital statistics (CRVS) systems should be the primary source of mortality data for governments. Accurate and timely measurement of the completeness of death registration helps inform interventions to improve CRVS systems and to generate reliable mortality indicators. In this work we propose the use of hierarchical Bayesian linear mixed models with Global-Local (GL) priors to estimate the completeness of death registration at global, national and subnational levels. The use of GL priors in this paper is motivated for situations where demographic covariates can explain much of the observed completeness but where unexplained within-country (i.e. by year) and between-country variability also play an important role. The use of our approach can allow institutions improve model parameter estimates and more accurately predict completeness of death registration. Our models are based on a dataset which uses Global Burden of Disease (GBD) death estimates based on the GBD 2019 and comprises 120 countries and 2,748 country-years from 1970-2019 (Demographics Collaborators, 2020). To illustrate the effectiveness of our proposal we consider the completeness of death registration in the departments of Colombia in 2017.


title: Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs

abstract: In this study, we introduce adaptive KV cache compression, a plug-and-play method that reduces the memory footprint of generative inference for Large Language Models (LLMs). Different from the conventional KV cache that retains key and value vectors for all context tokens, we conduct targeted profiling to discern the intrinsic structure of attention modules. Based on the recognized structure, we then construct the KV cache in an adaptive manner: evicting long-range contexts on attention heads emphasizing local contexts, discarding non-special tokens on attention heads centered on special tokens, and only employing the standard KV cache for attention heads that broadly attend to all tokens. Moreover, with the lightweight attention profiling used to guide the construction of the adaptive KV cache, FastGen can be deployed without resource-intensive fine-tuning or re-training. In our experiments across various asks, FastGen demonstrates substantial reduction on GPU memory consumption with negligible generation quality loss. We will release our code and the compatible CUDA kernel for reproducibility.


title: Unifying Safety Approaches for Stochastic Systems: From Barrier Functions to Uncertain Abstractions via Dynamic Programming

abstract: Providing safety guarantees for stochastic dynamical systems has become a central problem in many fields, including control theory, machine learning, and robotics. Existing methods either employ Stochastic Barrier Functions (SBFs) or rely on numerical approaches based on abstractions. While SBFs are analogous to Lyapunov functions to prove (probabilistic) set invariance, abstraction-based approaches approximate the stochastic system into a finite model for the computation of safety probability bounds. In this paper, we offer a new perspective on these seemingly different methods. We show that both these approaches arise as approximations of a stochastic dynamic programming problem. Such a new and unifying perspective allows us to formally show the correctness of both approaches, characterize their convergence and optimality properties, and examine advantages and disadvantages of each. Our analysis reveals that abstraction-based methods can provide more accurate certificates of safety, but generally at a higher computational cost. We conclude the article with a discussion that highlights possible future directions.


title: Evaluation of Cross-Lingual Bug Localization: Two Industrial Cases

abstract: This study reports the results of applying the cross-lingual bug localization approach proposed by Xia et al. to industrial software projects. To realize cross-lingual bug localization, we applied machine translation to non-English descriptions in the source code and bug reports, unifying them into English-based texts, to which an existing English-based bug localization technique was applied. In addition, a prototype tool based on BugLocator was implemented and applied to two Japanese industrial projects, which resulted in a slightly different performance from that of Xia et al.


title: High-rate multiplexed entanglement source based on time-bin qubits for advanced quantum networks

abstract: Entanglement distribution based on time-bin qubits is an attractive option for emerging quantum networks. We demonstrate a 4.09 GHz repetition rate source of photon pairs entangled across early and late time bins separated by 80 ps. Simultaneous high rates and high visibilities are achieved through frequency multiplexing the spontaneous parametric down conversion output into 8 time-bin entangled pairs. We demonstrate entanglement visibilities as high as 99.4%, total entanglement rates up to 3.55e6 coincidences/s, and predict a straightforward path towards achieving up to an order of magnitude improvement in rates without compromising visibility. Finally, we resolve the density matrices of the entangled states for each multiplexed channel and express distillable entanglement rates in ebit/s, thereby quantifying the tradeoff between visibility and coincidence rates that contributes to useful entanglement distribution. This source is a fundamental building block for high-rate entanglement-based quantum key distribution systems or advanced quantum networks.


title: Comparative study of microgrid optimal scheduling under multi-optimization algorithm fusion

abstract: As global attention on renewable and clean energy grows, the research and implementation of microgrids become paramount. This paper delves into the methodology of exploring the relationship between the operational and environmental costs of microgrids through multi-objective optimization models. By integrating various optimization algorithms like Genetic Algorithm, Simulated Annealing, Ant Colony Optimization, and Particle Swarm Optimization, we propose an integrated approach for microgrid optimization. Simulation results depict that these algorithms provide different dispatch results under economic and environmental dispatch, revealing distinct roles of diesel generators and micro gas turbines in microgrids. Overall, this study offers in-depth insights and practical guidance for microgrid design and operation.


title: Improvement and Enhancement of YOLOv5 Small Target Recognition Based on Multi-module Optimization

abstract: In this paper, the limitations of YOLOv5s model on small target detection task are deeply studied and improved. The performance of the model is successfully enhanced by introducing GhostNet-based convolutional module, RepGFPN-based Neck module optimization, CA and Transformer's attention mechanism, and loss function improvement using NWD. The experimental results validate the positive impact of these improvement strategies on model precision, recall and mAP. In particular, the improved model shows significant superiority in dealing with complex backgrounds and tiny targets in real-world application tests. This study provides an effective optimization strategy for the YOLOv5s model on small target detection, and lays a solid foundation for future related research and applications.


title: Discrete, compositional, and symbolic representations through attractor dynamics

abstract: Compositionality is an important feature of discrete symbolic systems, such as language and programs, as it enables them to have infinite capacity despite a finite symbol set. It serves as a useful abstraction for reasoning in both cognitive science and in AI, yet the interface between continuous and symbolic processing is often imposed by fiat at the algorithmic level, such as by means of quantization or a softmax sampling step. In this work, we explore how discretization could be implemented in a more neurally plausible manner through the modeling of attractor dynamics that partition the continuous representation space into basins that correspond to sequences of symbols. Building on established work in attractor networks and introducing novel training methods, we show that imposing structure in the symbolic space can produce compositionality in the attractor-supported representation space of rich sensory inputs. Lastly, we argue that our model exhibits the process of an information bottleneck that is thought to play a role in conscious experience, decomposing the rich information of a sensory input into stable components encoding symbolic information.


title: Simulation-based Inference with the Generalized Kullback-Leibler Divergence

abstract: In Simulation-based Inference, the goal is to solve the inverse problem when the likelihood is only known implicitly. Neural Posterior Estimation commonly fits a normalized density estimator as a surrogate model for the posterior. This formulation cannot easily fit unnormalized surrogates because it optimizes the Kullback-Leibler divergence. We propose to optimize a generalized Kullback-Leibler divergence that accounts for the normalization constant in unnormalized distributions. The objective recovers Neural Posterior Estimation when the model class is normalized and unifies it with Neural Ratio Estimation, combining both into a single objective. We investigate a hybrid model that offers the best of both worlds by learning a normalized base distribution and a learned ratio. We also present benchmark results.


title: Mel-Band RoFormer for Music Source Separation

abstract: Recently, multi-band spectrogram-based approaches such as Band-Split RNN (BSRNN) have demonstrated promising results for music source separation. In our recent work, we introduce the BS-RoFormer model which inherits the idea of band-split scheme in BSRNN at the front-end, and then uses the hierarchical Transformer with Rotary Position Embedding (RoPE) to model the inner-band and inter-band sequences for multi-band mask estimation. This model has achieved state-of-the-art performance, but the band-split scheme is defined empirically, without analytic supports from the literature. In this paper, we propose Mel-RoFormer, which adopts the Mel-band scheme that maps the frequency bins into overlapped subbands according to the mel scale. In contract, the band-split mapping in BSRNN and BS-RoFormer is non-overlapping and designed based on heuristics. Using the MUSDB18HQ dataset for experiments, we demonstrate that Mel-RoFormer outperforms BS-RoFormer in the separation tasks of vocals, drums, and other stems.


title: High angular momentum coupling for enhanced Rydberg-atom sensing in the VHF band

abstract: Recent advances in Rydberg atom electrometry detail promising applications in radio frequency (RF) communications. Presently, most applications use carrier frequencies greater than 1~GHz where resonant Autler-Townes splitting provides the highest sensitivity. This letter documents a series of experiments with Rydberg atomic sensors to collect and process waveforms from the automated identification system (AIS) used in maritime navigation in the Very High Frequency (VHF) band. Detection in this band is difficult with conventional resonant Autler-Townes based Rydberg sensing and requires a new approach. We show the results from a new method called High Angular Momentum Matching Excited Raman (HAMMER), which enhances low frequency detection and exhibits superior sensitivity compared to the traditional AC Stark effect. From measurements of electromagnetically induced transparency (EIT) in rubidium and cesium vapor cells, we show the relationship between incident electric field strength and observed signal-to-noise ratio and find that the sensitivity of the HAMMER scheme in rubidium achieved an equivalent single VHF tone sensitivity of $\mathrm{100~\mu V/m/\sqrt{Hz}}$. With these results, we estimate the usable range of the atomic vapor cell antenna for AIS waveforms given current technology and detection techniques.


title: The Laplacian spectral moments of power hypergraphs

abstract: The $d$-th order Laplacian spectral moment of a $k$-uniform hypergraph is the sum of the $d$-th powers of all eigenvalues of its Laplacian tensor. In this paper, we obtain some expressions of the Laplacian spectral moments for $k$-uniform power hypergraphs, and these expressions can be represented by some parameters of graphs. And we show that some graphs can be determined by their high-order Laplacian spectrum by using the Laplacian spectral moments of power hypergraphs.


title: PPT: Token Pruning and Pooling for Efficient Vision Transformers

abstract: Vision Transformers (ViTs) have emerged as powerful models in the field of computer vision, delivering superior performance across various vision tasks. However, the high computational complexity poses a significant barrier to their practical applications in real-world scenarios. Motivated by the fact that not all tokens contribute equally to the final predictions and fewer tokens bring less computational cost, reducing redundant tokens has become a prevailing paradigm for accelerating vision transformers. However, we argue that it is not optimal to either only reduce inattentive redundancy by token pruning, or only reduce duplicative redundancy by token merging. To this end, in this paper we propose a novel acceleration framework, namely token Pruning & Pooling Transformers (PPT), to adaptively tackle these two types of redundancy in different layers. By heuristically integrating both token pruning and token pooling techniques in ViTs without additional trainable parameters, PPT effectively reduces the model complexity while maintaining its predictive accuracy. For example, PPT reduces over 37% FLOPs and improves the throughput by over 45% for DeiT-S without any accuracy drop on the ImageNet dataset. The code is available at https://github.com/xjwu1024/PPT and https://github.com/mindspore-lab/models/


title: Semi-analytic calculations for extended mid-Infrared emission associated with FU Ori-type objects

abstract: (Aims) Near-infrared imaging polarimetry at high-angular resolutions has revealed intriguing distribution of circumstellar dust towards FU Ori-type objects (FUors). These dust grains are probably associated with either an accretion disk or an infalling envelope. Follow-up observations in the mid-infrared would lead us to a better understanding of the hierarchy of the mass accretion processes onto FUors (i.e., envelope and disk accretion), which hold keys for understanding the mechanism of their accretion outbursts and the growth of low-mass young stellar objects in general. (Method) We have developed a semi-analytic method to estimate the mid-infrared intensity distributions using the observed polarized intensity (PI) distributions in H-band (lambda=1.65 micron). We have derived intensity distributions for two FUors, FU Ori and V1735 Cyg, at three wavelengths (lambda=3.5/4.8/12 micron) for various cases, i.e. with a star or a flat compact self-luminous disk as an illuminating source; an optically thick disk or an optically thin envelope for circumstellar dust grains; and three different dust models. (Results) We have been able to obtain self-consistent results for many cases and regions, in particular when the viewing angle of the disk/envelope is zero (face-on). Our calculations suggest that the mid-infrared extended emission at the above wavelengths is dominated by the single scattering process. The contribution of thermal emission is negligible unless we add an additional heating mechanism such as adiabatic heating in spiral structures and/or fragments. The uncertain nature of the central illuminating source, the distribution of circumstellar dust grains and the optical properties of dust grains yield uncertainties in the intensity levels on orders of magnitude, e.g., 20-800, for the disk/envelope aspect ratios of ~0.2 and lambda=3-13 micron.


title: Statistical Issues on the Neutrino Mass Hierarchy with $\Delta \chi^{2}$

abstract: The Neutrino Mass Hierarchy Determination ($\nu$ MHD) is one of the main goals of the major current and future neutrino experiments. The statistical analysis usually proceeds from a standard method, a single dimensional estimator $(1D-\Delta \chi^{2})$ that shows some draw-backs and concerns, together with a debatable strategy. The draw-backs and considerations of the standard method will be explianed through the following three main issues. First issue is the limited power of the standard method. The $\Delta \chi^{2}$ estimator provides us with different results when different simulation procedures were used. Second issue, when $\chi^{2}_{min(NH)}$ and $\chi^{2}_{min(IH)}$ are drawn in a $2D$ map, their strong positive correlation manifests $\chi^{2}$ as a bi-dimensional instead of single dimensional estimator. The overlapping between the $\chi^{2}$ distributions of the two hypotheses leads to the experiment sensitivity reduction. Third issue is the robustness of the standard method. When the JUNO sensitivity is obtained using different procedures, $\Delta \chi^{2}$ as one dimensional and $\chi^{2}$ as two dimensional estimator, the experimental sensitivity varies with the different values of the atmospheric mass, the input parameter. We computed the oscillation of $\vert\overline{\Delta \chi^{2}} \vert$ with the input parameter values, $\vert\Delta m^{2} \vert_{input}$. The MH significance using the standard method, $\Delta\chi^{2}$, strongly depends on the values of the parameter $\vert\Delta m^{2} \vert_{input}$. Consequently, the experiment sensitivity depends on the precision of the atmospheric mass. This evaluation of the standard method confirms the draw-backs.


title: What Determines the Price of NFTs?

abstract: In the evolving landscape of digital art, Non-Fungible Tokens (NFTs) have emerged as a groundbreaking platform, bridging the realms of art and technology. NFTs serve as the foundational framework that has revolutionized the market for digital art, enabling artists to showcase and monetize their creations in unprecedented ways. NFTs combine metadata stored on the blockchain with off-chain data, such as images, to create a novel form of digital ownership. It is not fully understood how these factors come together to determine NFT prices. In this study, we analyze both on-chain and off-chain data of NFT collections trading on OpenSea to understand what influences NFT pricing. Our results show that while text and image data of the NFTs can be used to explain price variations within collections, the extracted features do not generalize to new, unseen collections. Furthermore, we find that an NFT collection's trading volume often relates to its online presence, like social media followers and website traffic.


title: On the natural nullcones of the symplectic and general linear groups

abstract: Consider a group acting on a polynomial ring $S$ over a field $K$ by degree-preserving $K$-algebra automorphisms. The invariant ring $R$ is a graded subring of $S$; let $\mathfrak{m}_R$ denote the homogeneous maximal ideal of $R$. Several key properties of the invariant ring and its embedding in $S$ can be deduced by studying the nullcone $S/\mathfrak{m}_R S$ of the group action. This includes, for example, the finite generation of the invariant ring and the purity of the embedding. In this article, we study the nullcones arising from the natural actions of the symplectic and general linear groups. For the natural representation of the symplectic group, the invariant ring is the ring defined by the principal Pfaffians of a fixed even size of a generic alternating matrix. We show that the nullcone of this embedding is a strongly $F$-regular ring in positive characteristic, and hence in characteristic zero, a ring of strongly $F$-regular type. Independent of characteristic, we give a complete description of the divisor class group of the nullcone and determine precisely when it is Gorenstein. We also show that the nullcone ideal has a squarefree initial ideal. For the natural representation of the general linear group, the invariant ring is a generic determinantal ring. The nullcone of this embedding is typically a non-equidimensional ring. The irreducible components of the nullcone are the varieties of complexes of length two, as introduced by Buchsbaum and Eisenbud. We show that each of these irreducible components define strongly $F$-regular rings in positive characteristic. We also show that the Frobenius splitting of the varieties of complexes can be chosen compatibly; it follows that the nullcone is an $F$-pure ring. We also show that the nullcone ideal and the ideals defining the varieties of complexes have squarefree initial ideals with respect to the same monomial order.


title: The Note on the Closure of Continuous Functions in Variable-Exponent Lebesgue Spaces for Multiple Variables

abstract: In this paper, we generalize a recently obtained result by Kopaliani and Zviadadze from the one-variable case to the several-variable case. Specifically, in terms of decreasing rearrangement, we characterize those exponents $p(\cdot)$ for which the corresponding variable-exponent Lebesgue space $L^{p(\cdot)}([0;1]^n)$ shares the property with $L^\infty([0;1]^n)$ such that the space of continuous functions $C([0;1]^n)$ forms a closed linear subspace in $L^{p(\cdot)}([0;1]^n)$ . In particular, we derive the necessary and sufficient conditions on the decreasing rearrangement of the exponent $p(\cdot)$ for which there exists an equimeasurable exponent of $p(\cdot)$ such that the corresponding variable-exponent Lebesgue space possesses the aforementioned property.


title: AutoLoRa: A Parameter-Free Automated Robust Fine-Tuning Framework

abstract: Robust Fine-Tuning (RFT) is a low-cost strategy to obtain adversarial robustness in downstream applications, without requiring a lot of computational resources and collecting significant amounts of data. This paper uncovers an issue with the existing RFT, where optimizing both adversarial and natural objectives through the feature extractor (FE) yields significantly divergent gradient directions. This divergence introduces instability in the optimization process, thereby hindering the attainment of adversarial robustness and rendering RFT highly sensitive to hyperparameters. To mitigate this issue, we propose a low-rank (LoRa) branch that disentangles RFT into two distinct components: optimizing natural objectives via the LoRa branch and adversarial objectives via the FE. Besides, we introduce heuristic strategies for automating the scheduling of the learning rate and the scalars of loss terms. Extensive empirical evaluations demonstrate that our proposed automated RFT disentangled via the LoRa branch (AutoLoRa) achieves new state-of-the-art results across a range of downstream tasks. AutoLoRa holds significant practical utility, as it automatically converts a pre-trained FE into an adversarially robust model for downstream tasks without the need for searching hyperparameters.


title: TP2O: Creative Text Pair-to-Object Generation using Balance Swap-Sampling

abstract: Generating creative combinatorial objects from two seemingly unrelated object texts is a challenging task in text-to-image synthesis, often hindered by a focus on emulating existing data distributions. In this paper, we develop a straightforward yet highly effective method, called \textbf{balance swap-sampling}. First, we propose a swapping mechanism that generates a novel combinatorial object image set by randomly exchanging intrinsic elements of two text embeddings through a cutting-edge diffusion model. Second, we introduce a balance swapping region to efficiently sample a small subset from the newly generated image set by balancing CLIP distances between the new images and their original generations, increasing the likelihood of accepting the high-quality combinations. Last, we employ a segmentation method to compare CLIP distances among the segmented components, ultimately selecting the most promising object from the sampled subset. Extensive experiments demonstrate that our approach outperforms recent SOTA T2I methods. Surprisingly, our results even rival those of human artists, such as frog-broccoli.


title: Towards Robust Fidelity for Evaluating Explainability of Graph Neural Networks

abstract: Graph Neural Networks (GNNs) are neural models that leverage the dependency structure in graphical data via message passing among the graph nodes. GNNs have emerged as pivotal architectures in analyzing graph-structured data, and their expansive application in sensitive domains requires a comprehensive understanding of their decision-making processes -- necessitating a framework for GNN explainability. An explanation function for GNNs takes a pre-trained GNN along with a graph as input, to produce a `sufficient statistic' subgraph with respect to the graph label. A main challenge in studying GNN explainability is to provide fidelity measures that evaluate the performance of these explanation functions. This paper studies this foundational challenge, spotlighting the inherent limitations of prevailing fidelity metrics, including $Fid_+$, $Fid_-$, and $Fid_\Delta$. Specifically, a formal, information-theoretic definition of explainability is introduced and it is shown that existing metrics often fail to align with this definition across various statistical scenarios. The reason is due to potential distribution shifts when subgraphs are removed in computing these fidelity measures. Subsequently, a robust class of fidelity measures are introduced, and it is shown analytically that they are resilient to distribution shift issues and are applicable in a wide range of scenarios. Extensive empirical analysis on both synthetic and real datasets are provided to illustrate that the proposed metrics are more coherent with gold standard metrics. The source code is available at https://trustai4s-lab.github.io/fidelity.


title: MIMO-NeRF: Fast Neural Rendering with Multi-input Multi-output Neural Radiance Fields

abstract: Neural radiance fields (NeRFs) have shown impressive results for novel view synthesis. However, they depend on the repetitive use of a single-input single-output multilayer perceptron (SISO MLP) that maps 3D coordinates and view direction to the color and volume density in a sample-wise manner, which slows the rendering. We propose a multi-input multi-output NeRF (MIMO-NeRF) that reduces the number of MLPs running by replacing the SISO MLP with a MIMO MLP and conducting mappings in a group-wise manner. One notable challenge with this approach is that the color and volume density of each point can differ according to a choice of input coordinates in a group, which can lead to some notable ambiguity. We also propose a self-supervised learning method that regularizes the MIMO MLP with multiple fast reformulated MLPs to alleviate this ambiguity without using pretrained models. The results of a comprehensive experimental evaluation including comparative and ablation studies are presented to show that MIMO-NeRF obtains a good trade-off between speed and quality with a reasonable training time. We then demonstrate that MIMO-NeRF is compatible with and complementary to previous advancements in NeRFs by applying it to two representative fast NeRFs, i.e., a NeRF with sample reduction (DONeRF) and a NeRF with alternative representations (TensoRF).


title: Simplicial Tur\'an problems

abstract: A simplicial complex $H$ consists of a pair of sets $(V,E)$ where $V$ is a set of vertices and $E\subseteq\mathscr{P}(V)$ is a collection of subsets of $V$ closed under taking subsets. Given a simplicial complex $F$ and $n\in \mathbb N$, the extremal number $\text{ex}(n,F)$ is the maximum number of edges that a simplicial complex on $n$ vertices can have without containing a copy of $F$. We initiate the systematic study of extremal numbers in this context by asymptotically determining the extremal numbers of several natural simplicial complexes. In particular, we asymptotically determine the extremal number of a simplicial complex for which the extremal example has more than one incomplete layer.


title: Integrability of Large-Charge Sectors in Generic 2D EFTs

abstract: It is shown that integrability is an accidental property of generic two-dimensional $O(2)$-symmetric asymptotically-free theories in the regime where the charge density is much larger than the dynamical scale. We show this by constructing an infinite tower of higher-spin conserved currents in the most generic effective Lagrangian at large chemical potential to all orders in perturbative expansion in the renormalization-group invariant coupling constant.


title: Mini-BEHAVIOR: A Procedurally Generated Benchmark for Long-horizon Decision-Making in Embodied AI

abstract: We present Mini-BEHAVIOR, a novel benchmark for embodied AI that challenges agents to use reasoning and decision-making skills to solve complex activities that resemble everyday human challenges. The Mini-BEHAVIOR environment is a fast, realistic Gridworld environment that offers the benefits of rapid prototyping and ease of use while preserving a symbolic level of physical realism and complexity found in complex embodied AI benchmarks. We introduce key features such as procedural generation, to enable the creation of countless task variations and support open-ended learning. Mini-BEHAVIOR provides implementations of various household tasks from the original BEHAVIOR benchmark, along with starter code for data collection and reinforcement learning agent training. In essence, Mini-BEHAVIOR offers a fast, open-ended benchmark for evaluating decision-making and planning solutions in embodied AI. It serves as a user-friendly entry point for research and facilitates the evaluation and development of solutions, simplifying their assessment and development while advancing the field of embodied AI. Code is publicly available at https://github.com/StanfordVL/mini_behavior.


title: Empirical Study of PEFT techniques for Winter Wheat Segmentation

abstract: Parameter Efficient Fine Tuning (PEFT) techniques have recently experienced significant growth and have been extensively employed to adapt large vision and language models to various domains, enabling satisfactory model performance with minimal computational needs. Despite these advances, more research has yet to delve into potential PEFT applications in real-life scenarios, particularly in the critical domains of remote sensing and crop monitoring. The diversity of climates across different regions and the need for comprehensive large-scale datasets have posed significant obstacles to accurately identify crop types across varying geographic locations and changing growing seasons. This study seeks to bridge this gap by comprehensively exploring the feasibility of cross-area and cross-year out-of-distribution generalization using the State-of-the-Art (SOTA) wheat crop monitoring model. The aim of this work is to explore PEFT approaches for crop monitoring. Specifically, we focus on adapting the SOTA TSViT model to address winter wheat field segmentation, a critical task for crop monitoring and food security. This adaptation process involves integrating different PEFT techniques, including BigFit, LoRA, Adaptformer, and prompt tuning. Using PEFT techniques, we achieved notable results comparable to those achieved using full fine-tuning methods while training only a mere 0.7% parameters of the whole TSViT architecture. The in-house labeled data-set, referred to as the Beqaa-Lebanon dataset, comprises high-quality annotated polygons for wheat and non-wheat classes with a total surface of 170 kmsq, over five consecutive years. Using Sentinel-2 images, our model achieved a 84% F1-score. We intend to publicly release the Lebanese winter wheat data set, code repository, and model weights.


title: Grid-Forming Control Methods for Weakly Connected Offshore WPPs

abstract: Grid-forming control (GFC) has seen numerous technological advances in their control types, applications, and the multitude of services they provide. Some examples of the services they provide include black start, inertial frequency response, and islanded operation capabilities with the possibility of re-synchronization without the need of additional support from other devices such as storage. State of the art literature proposes a variety of GFCs which can provide single or multiple of these services. However, study of these different GFCs for weakly-connected offshore wind power plants (WPPs) based on time-domain simulation and focusing on the large signal disturbance is not well covered. This paper reviews some of the most researched grid-forming control methods applicable to offshore WPPs and provides a comparative investigation and discussion of their stability properties and applicability, especially when connected to a weak-grid. The paper also provides a discussion on the prerequisites and challenges surrounding the comparative study of different GFCs.


title: Learning and reusing primitive behaviours to improve Hindsight Experience Replay sample efficiency

abstract: Hindsight Experience Replay (HER) is a technique used in reinforcement learning (RL) that has proven to be very efficient for training off-policy RL-based agents to solve goal-based robotic manipulation tasks using sparse rewards. Even though HER improves the sample efficiency of RL-based agents by learning from mistakes made in past experiences, it does not provide any guidance while exploring the environment. This leads to very large training times due to the volume of experience required to train an agent using this replay strategy. In this paper, we propose a method that uses primitive behaviours that have been previously learned to solve simple tasks in order to guide the agent toward more rewarding actions during exploration while learning other more complex tasks. This guidance, however, is not executed by a manually designed curriculum, but rather using a critic network to decide at each timestep whether or not to use the actions proposed by the previously-learned primitive policies. We evaluate our method by comparing its performance against HER and other more efficient variations of this algorithm in several block manipulation tasks. We demonstrate the agents can learn a successful policy faster when using our proposed method, both in terms of sample efficiency and computation time. Code is available at https://github.com/franroldans/qmp-her.