title: Reduced-order models of wall shear stress patterns in the left atrial appendage from a data-augmented atrial database

abstract: Background: Atrial fibrillation (AF) is the most common sustained cardiac arrhythmia, affecting over 1% of the population. It is usually triggered by irregular electrical impulses that cause the atria to contract irregularly and ineffectively. It increases blood stasis and the risk of thrombus formation within the left atrial appendage (LAA) and aggravates adverse atrial remodeling. Despite recent efforts, LAA flow patterns representative of AF conditions and their association with LAA stasis remain poorly characterized. Aim: To develop reduced-order data-driven models of LAA flow patterns during atrial remodeling in order to uncover flow disturbances concurrent with LAA stasis that could add granularity to clinical decision criteria. Methods: We combined a geometric data augmentation process with projection of results from 180 CFD atrial simulations on a universal LAA coordinate (ULAAC) system. The projection approach enhances data visualization and facilitates direct comparison between different anatomical and functional states. ULAAC projections were used as input for a proper orthogonal decomposition (POD) algorithm to build reduced-order models of hemodynamic metrics, extracting flow characteristics associated with AF and non-AF anatomies. Results: We verified that the ULAAC system provides an adequate representation to visualize data distributions on the LAA surface and to build POD-based reduced-order models. These models revealed significant differences in LAA flow patterns for atrial geometries that underwent adverse atrial remodeling and experienced elevated blood stasis. Together with anatomical morphing-based patient-specific data augmentation, this approach could facilitate data-driven analyses to identify flow features associated with thrombosis risk due to atrial remodeling.


title: Waveform Design for MIMO-OFDM Integrated Sensing and Communication System: An Information Theoretical Approach

abstract: Integrated sensing and communication (ISAC) is regarded as the enabling technology in the future 5th-Generation-Advanced (5G-A) and 6th-Generation (6G) mobile communication system. ISAC waveform design is critical in ISAC system. However, the difference of the performance metrics between sensing and communication brings challenges for the ISAC waveform design. This paper applies the unified performance metrics in information theory, namely mutual information (MI), to measure the communication and sensing performance in multicarrier ISAC system. In multi-input multi-output orthogonal frequency division multiplexing (MIMO-OFDM) ISAC system, we first derive the sensing and communication MI with subcarrier correlation and spatial correlation. Then, we propose optimal waveform designs for maximizing the sensing MI, communication MI and the weighted sum of sensing and communication MI, respectively. The optimization results are validated by Monte Carlo simulations. Our work provides effective closed-form expressions for waveform design, enabling the realization of MIMO-OFDM ISAC system with balanced performance in communication and sensing.


title: AngioMoCo: Learning-based Motion Correction in Cerebral Digital Subtraction Angiography

abstract: Cerebral X-ray digital subtraction angiography (DSA) is the standard imaging technique for visualizing blood flow and guiding endovascular treatments. The quality of DSA is often negatively impacted by body motion during acquisition, leading to decreased diagnostic value. Time-consuming iterative methods address motion correction based on non-rigid registration, and employ sparse key points and non-rigidity penalties to limit vessel distortion. Recent methods alleviate subtraction artifacts by predicting the subtracted frame from the corresponding unsubtracted frame, but do not explicitly compensate for motion-induced misalignment between frames. This hinders the serial evaluation of blood flow, and often causes undesired vasculature and contrast flow alterations, leading to impeded usability in clinical practice. To address these limitations, we present AngioMoCo, a learning-based framework that generates motion-compensated DSA sequences from X-ray angiography. AngioMoCo integrates contrast extraction and motion correction, enabling differentiation between patient motion and intensity changes caused by contrast flow. This strategy improves registration quality while being substantially faster than iterative elastix-based methods. We demonstrate AngioMoCo on a large national multi-center dataset (MR CLEAN Registry) of clinically acquired angiographic images through comprehensive qualitative and quantitative analyses. AngioMoCo produces high-quality motion-compensated DSA, removing motion artifacts while preserving contrast flow. Code is publicly available at https://github.com/RuishengSu/AngioMoCo.


title: RetSeg: Retention-based Colorectal Polyps Segmentation Network

abstract: Vision Transformers (ViTs) have revolutionized medical imaging analysis, showcasing superior efficacy compared to conventional Convolutional Neural Networks (CNNs) in vital tasks such as polyp classification, detection, and segmentation. Leveraging attention mechanisms to focus on specific image regions, ViTs exhibit contextual awareness in processing visual data, culminating in robust and precise predictions, even for intricate medical images. Moreover, the inherent self-attention mechanism in Transformers accommodates varying input sizes and resolutions, granting an unprecedented flexibility absent in traditional CNNs. However, Transformers grapple with challenges like excessive memory usage and limited training parallelism due to self-attention, rendering them impractical for real-time disease detection on resource-constrained devices. In this study, we address these hurdles by investigating the integration of the recently introduced retention mechanism into polyp segmentation, introducing RetSeg, an encoder-decoder network featuring multi-head retention blocks. Drawing inspiration from Retentive Networks (RetNet), RetSeg is designed to bridge the gap between precise polyp segmentation and resource utilization, particularly tailored for colonoscopy images. We train and validate RetSeg for polyp segmentation employing two publicly available datasets: Kvasir-SEG and CVC-ClinicDB. Additionally, we showcase RetSeg's promising performance across diverse public datasets, including CVC-ColonDB, ETIS-LaribPolypDB, CVC-300, and BKAI-IGH NeoPolyp. While our work represents an early-stage exploration, further in-depth studies are imperative to advance these promising findings.


title: Towards Fair and Comprehensive Comparisons for Image-Based 3D Object Detection

abstract: In this work, we build a modular-designed codebase, formulate strong training recipes, design an error diagnosis toolbox, and discuss current methods for image-based 3D object detection. In particular, different from other highly mature tasks, e.g., 2D object detection, the community of image-based 3D object detection is still evolving, where methods often adopt different training recipes and tricks resulting in unfair evaluations and comparisons. What is worse, these tricks may overwhelm their proposed designs in performance, even leading to wrong conclusions. To address this issue, we build a module-designed codebase and formulate unified training standards for the community. Furthermore, we also design an error diagnosis toolbox to measure the detailed characterization of detection models. Using these tools, we analyze current methods in-depth under varying settings and provide discussions for some open questions, e.g., discrepancies in conclusions on KITTI-3D and nuScenes datasets, which have led to different dominant methods for these datasets. We hope that this work will facilitate future research in image-based 3D object detection. Our codes will be released at \url{https://github.com/OpenGVLab/3dodi}


title: Second Order Expansion of Gibbs State Reduced Densities in the Gross-Pitaevskii Regime

abstract: We consider a translation-invariant system of $N$ bosons in $\mathbb{T}^{3}$ that interact through a repulsive two-body potential with scattering length of order $N^{-1}$ in the limit $N\to \infty$. We derive second order expressions for the one- and two-particle reduced density matrices of the Gibbs state at fixed positive temperatures, thus obtaining a justification of Bogoliubov's prediction on the fluctuations around the condensate.


title: Generalized Landauer bound from absolute irreversibility

abstract: In this work, we introduce a generalization of the Landauer bound for erasure processes that stems from absolutely irreversible dynamics. Assuming that the erasure process is carried out in an absolutely irreversible way so that the probability of observing some trajectories is zero in the forward process but finite in the reverse process, we derive a generalized form of the bound for the average erasure work, which is valid also for imperfect erasure and asymmetric bits. The generalized bound obtained is tighter or, at worst, as tight as existing ones. Our theoretical predictions are supported by numerical experiments and the comparison with data from previous works.


title: Empower Nested Boolean Logic via Self-Supervised Curriculum Learning

abstract: Beyond the great cognitive powers showcased by language models, it is crucial to scrutinize whether their reasoning capabilities stem from strong generalization or merely exposure to relevant data. As opposed to constructing increasingly complex logic, this paper probes into the boolean logic, the root capability of a logical reasoner. We find that any pre-trained language models even including large language models only behave like a random selector in the face of multi-nested boolean logic, a task that humans can handle with ease. To empower language models with this fundamental capability, this paper proposes a new self-supervised learning method \textit{Curriculum Logical Reasoning} (\textsc{Clr}), where we augment the training data with nested boolean logic chain step-by-step, and program the training from simpler logical patterns gradually to harder ones. This new training paradigm allows language models to effectively generalize to much harder and longer-hop logic, which can hardly be learned through naive training. Furthermore, we show that boolean logic is a great foundation for improving the subsequent general logical tasks.


title: Stability for an interface transmission problem of wave-plate equations with dynamical boundary controls

abstract: We investigate a two-dimensional transmission model consisting of a wave equation and a Kirchhoff plate equation with dynamical boundary controls under geometric conditions. The two equations are coupled through transmission conditions along a steady interface between the domains in which the wave and plate equations evolve, respectively. Our primary concern is the stability analysis of the system, which has not appeared in the literature. For this aim, using a unique continuation theorem, the strong stability of the system is proved without any geometric condition and in the absence of compactness of the resolvent. Then, we show that our system lacks exponential (uniform) stability. However, we establish a polynomial energy decay estimate of type 1/t for smooth initial data using the frequency domain approach from semigroup theory, which combines a contradiction argument with the multiplier technique. This method leads to certain geometrical conditions concerning the wave's and the plate's domains.


title: Parrot Mind: Towards Explaining the Complex Task Reasoning of Pretrained Large Language Models with Template-Content Structure

abstract: The pre-trained large language models (LLMs) have shown their extraordinary capacity to solve reasoning tasks, even on tasks that require a complex process involving multiple sub-steps. However, given the vast possible generation space of all the tasks, how the pretrained model learns the reasoning ability remains an open question. We firstly propose that an intrinsic structural constraint on the generated sequence of language-based reasoning -- we called it template-content structure (T-C structure) -- is the key to explain why LLMs can solve a large number of complex reasoning problems with limited training data by showing this structure can reduce the possible space from exponential level to linear level. Furthermore, by generalizing this structure to the hierarchical case, we demonstrate that models can achieve task composition, further reducing the space needed to learn from linear to logarithmic, thereby effectively learning on complex reasoning involving multiple steps. We provide both examples and formal theory of our T-C structure. We also experimentally validate the existence of the T-C structure in some current LLMs and its effectiveness for reasoning.


title: Memory-Assisted Sub-Prototype Mining for Universal Domain Adaptation

abstract: Universal domain adaptation aims to align the classes and reduce the feature gap between the same category of the source and target domains. The target private category is set as the unknown class during the adaptation process, as it is not included in the source domain. However, most existing methods overlook the intra-class structure within a category, especially in cases where there exists significant concept shift between the samples belonging to the same category. When samples with large concept shift are forced to be pushed together, it may negatively affect the adaptation performance. Moreover, from the interpretability aspect, it is unreasonable to align visual features with significant differences, such as fighter jets and civil aircraft, into the same category. Unfortunately, due to such semantic ambiguity and annotation cost, categories are not always classified in detail, making it difficult for the model to perform precise adaptation. To address these issues, we propose a novel Memory-Assisted Sub-Prototype Mining (MemSPM) method that can learn the differences between samples belonging to the same category and mine sub-classes when there exists significant concept shift between them. By doing so, our model learns a more reasonable feature space that enhances the transferability and reflects the inherent differences among samples annotated as the same category. We evaluate the effectiveness of our MemSPM method over multiple scenarios, including UniDA, OSDA, and PDA. Our method achieves state-of-the-art performance on four benchmarks in most cases.


title: Markoff-Lagrange spectrum of one-sided shifts

abstract: For the Lagrange spectrum and other applications, we determine the smallest accumulation point of binary sequences that are maximal in their shift orbits. This problem is trivial for the lexicographic order, and its solution is the fixed point of a substitution for the alternating lexicographic order. For orders defined by cylinders, we show that the solutions are $S$-adic sequences, where $S$ is a certain infinite set of substitutions that includes Sturmian morphisms. We also consider a similar problem for symmetric ternary shifts, which is applicable to the multiplicative version of the Markoff-Lagrange spectrum.


title: Band structures of strained Kagome lattices

abstract: Materials with kagome lattice have attracted significant research attention due to their nontrivial features in energy bands. In this work, we theoretically investigate the evolution of electronic band structures of kagome lattice in response to uniaxial strain using both a tight-binding model and an antidot model based on a periodic muffin-tin potential. It is found that the Dirac points move with applied strain. Furthermore, the flat band of unstrained kagome lattice is found to develop into a highly anisotropic shape under a stretching strain along y direction, forming a partially flat band with a region dispersionless along ky direction while dispersive along kx direction. Our results shed light on the possibility of engineering the electronic band structures of kagome materials by mechanical strain.


title: Ensemble-based Hybrid Optimization of Bayesian Neural Networks and Traditional Machine Learning Algorithms

abstract: This research introduces a novel methodology for optimizing Bayesian Neural Networks (BNNs) by synergistically integrating them with traditional machine learning algorithms such as Random Forests (RF), Gradient Boosting (GB), and Support Vector Machines (SVM). Feature integration solidifies these results by emphasizing the second-order conditions for optimality, including stationarity and positive definiteness of the Hessian matrix. Conversely, hyperparameter tuning indicates a subdued impact in improving Expected Improvement (EI), represented by EI(x). Overall, the ensemble method stands out as a robust, algorithmically optimized approach.


title: Ricci pinched compact hypersurfaces in spheres

abstract: We investigate the topology of the compact hypersurfaces in round spheres whose Ricci curvature satisfies an appropriate bound that only depends on the mean curvature of the submanifold. In this paper, the use of the Bochner technique allows same stronger results than the ones obtained by us in the case of submanifolds lying in any codimension.


title: On some zero-sum invariants for abelian groups of rank three

abstract: Let $G$ be an additive finite abelian group with exponent $\exp(G)$. For $L\subseteq \mathbb N$, let $\mathsf{s}_{L}(G)$ be the smallest integer $\ell$ such that every sequence $S$ over $G$ of length $\ell$ has a zero-sum subsequence $T$ of length $|T|\in L$. In this paper, we consider the invariants $\mathsf{s}_{[1,t]}(G)$ and $\mathsf{s}_{\{k\exp(G)\}}(G)$ (with $k\in \mathbb N$). We obtain precise values as well as upper bounds of the above invariants for some abelian groups of rank three. Some of these results improve previous results of Gao-Thangadurai and Han-Zhang.


title: A Sobolev gradient flow for the area-normalised Dirichlet energy of $H^1$ maps

abstract: In this article we study the $H^1(du)$-gradient flow for the energy $E[X] = Q[X]/A[X]$ where $Q[X]$ is the Dirichlet energy of $X$, $A[X]$ is the signedenclosed area of $X$, and $X:\mathbb{S}\rightarrow\mathbb{R}^2$ is a $H^1(du)$ map. We prove that solutions with initially positive signed enclosed area exist eternally, and converge as $t\rightarrow\infty$ to a (possibly multiply-covered) circle. In this way we recover a parametrised isoperimetric inequality for $H^1(du)$ maps.


title: Robinson-Trautman solutions with scalar hair and Ricci flow

abstract: The vacuum Robinson-Trautman solution admits a shear-free and twist-free null geodesic congruence with a nonvanishing expansion. We perform a comprehensive classification of solutions exhibiting this property in Einstein's gravity with a massless scalar field, assuming that the solution belongs at least to Petrov-type II and some of the components of Ricci tensor identically vanish. We find that these solutions can be grouped into three distinct classes: (I-a) a natural extension of the Robinson-Trautman family incorporating a scalar hair satisfying the time derivative of the Ricci flow equation, (I-b) a novel non-asymptotically flat solution characterized by two functions satisfying Perelman's pair of the Ricci flow equations, and (II) a dynamical solution possessing ${\rm SO}(3)$, ${\rm ISO}(2)$ or ${\rm SO}(1,2)$ symmetry. We provide a complete list of all explicit solutions falling into Petrov type D for classes (I-a) and (I-b). Moreover, leveraging the massless solution in class (I-a), we derive the neutral Robinson-Trautman solution to the ${\cal N}=2$ gauged supergravity with the prepotential $F(X) =-iX^0X^1$. By flipping the sign of the kinetic term of the scalar field, the Petrov-D class (I-a) solution leads to a time-dependent wormhole with an instantaneous spacetime singularity. Although the general solution is unavailable for class (II), we find a new dynamical solution with spherical symmetry from the AdS-Roberts solution via AdS/Ricci-flat correspondence.


title: Sparsistency for Inverse Optimal Transport

abstract: Optimal Transport is a useful metric to compare probability distributions and to compute a pairing given a ground cost. Its entropic regularization variant (eOT) is crucial to have fast algorithms and reflect fuzzy/noisy matchings. This work focuses on Inverse Optimal Transport (iOT), the problem of inferring the ground cost from samples drawn from a coupling that solves an eOT problem. It is a relevant problem that can be used to infer unobserved/missing links, and to obtain meaningful information about the structure of the ground cost yielding the pairing. On one side, iOT benefits from convexity, but on the other side, being ill-posed, it requires regularization to handle the sampling noise. This work presents an in-depth theoretical study of the l1 regularization to model for instance Euclidean costs with sparse interactions between features. Specifically, we derive a sufficient condition for the robust recovery of the sparsity of the ground cost that can be seen as a far reaching generalization of the Lasso's celebrated Irrepresentability Condition. To provide additional insight into this condition, we work out in detail the Gaussian case. We show that as the entropic penalty varies, the iOT problem interpolates between a graphical Lasso and a classical Lasso, thereby establishing a connection between iOT and graph estimation, an important problem in ML.


title: AdaFuse: Adaptive Medical Image Fusion Based on Spatial-Frequential Cross Attention

abstract: Multi-modal medical image fusion is essential for the precise clinical diagnosis and surgical navigation since it can merge the complementary information in multi-modalities into a single image. The quality of the fused image depends on the extracted single modality features as well as the fusion rules for multi-modal information. Existing deep learning-based fusion methods can fully exploit the semantic features of each modality, they cannot distinguish the effective low and high frequency information of each modality and fuse them adaptively. To address this issue, we propose AdaFuse, in which multimodal image information is fused adaptively through frequency-guided attention mechanism based on Fourier transform. Specifically, we propose the cross-attention fusion (CAF) block, which adaptively fuses features of two modalities in the spatial and frequency domains by exchanging key and query values, and then calculates the cross-attention scores between the spatial and frequency features to further guide the spatial-frequential information fusion. The CAF block enhances the high-frequency features of the different modalities so that the details in the fused images can be retained. Moreover, we design a novel loss function composed of structure loss and content loss to preserve both low and high frequency information. Extensive comparison experiments on several datasets demonstrate that the proposed method outperforms state-of-the-art methods in terms of both visual quality and quantitative metrics. The ablation experiments also validate the effectiveness of the proposed loss and fusion strategy.


title: Adaptive and Efficient Isotonic Estimation in Wicksell's Problem

abstract: We consider nonparametric estimation in Wicksell's problem which has relevant applications in astronomy for estimating the distribution of the positions of the stars in a galaxy given projected stellar positions and in material sciences to determine the 3D microstructure of a material, using its 2D cross sections. In the classical setting, we study the isotonized version of the plug-in estimator (IIE) for the underlying cdf $F$ of the spheres' squared radii. This estimator is fully automatic, in the sense that it does not rely on tuning parameters, and we show it is adaptive to local smoothness properties of the distribution function $F$ to be estimated. Moreover, we prove a local asymptotic minimax lower bound in this non-standard setting, with $\sqrt{\log{n}/n}$-asymptotics and where the functional $F$ to be estimated is not regular. Combined, our results prove that the isotonic estimator (IIE) is an adaptive, easy-to-compute, and efficient estimator for estimating the underlying distribution function $F$.


title: Cost-Sensitive Best Subset Selection for Logistic Regression: A Mixed-Integer Conic Optimization Perspective

abstract: A key challenge in machine learning is to design interpretable models that can reduce their inputs to the best subset for making transparent predictions, especially in the clinical domain. In this work, we propose a certifiably optimal feature selection procedure for logistic regression from a mixed-integer conic optimization perspective that can take an auxiliary cost to obtain features into account. Based on an extensive review of the literature, we carefully create a synthetic dataset generator for clinical prognostic model research. This allows us to systematically evaluate different heuristic and optimal cardinality- and budget-constrained feature selection procedures. The analysis shows key limitations of the methods for the low-data regime and when confronted with label noise. Our paper not only provides empirical recommendations for suitable methods and dataset designs, but also paves the way for future research in the area of meta-learning.


title: Investigation on the Orbital Period Variations of NN Ser: Implications for the Hypothetical Planets, the Applegate Mechanism and the Orbital Stability

abstract: We present 36 new mid-eclipse times obtained between 2017 and 2023 using the T100 telescope in Turkey, extending the time span of the $O-C$ diagram to 25 years. Once again, these new observations show significant deviations from previous published models that were able to explain the observed variations of the binary period. We investigate two plausible explanations for this variability: the LTT effect due to the presence of one or two invisible low-mass (planetary) companion(s) in distant circumbinary orbits; other mechanisms, like e.g. the Applegate mechanism, associated with the magnetic cycles of the M-dwarf component of the WD+dM binary. Through MCMC analyzes, we demonstrate that the observed $O-C$ variability can be explained by the presence of a planet with a minimum mass of $\sim9.5 M_J$. This circumbinary planet orbits around the binary system with a period of about 19.5 years, maintaining a stable orbit for a timeline of 10 Myr. By adding a weak LTT signal from a secondary hypothetical planet we achieve statistically better results. However, the orbits of the bodies in a two-planet system remain stable only for a small range of the parameter space. The energy required to power the Applegate and other Applegate-like mechanisms is too high to explain the period variations observed. Thus, on the one hand there is substantial evidence supporting the existence of a planet in the NN Ser system, but on the other hand there are also compelling indications that cast doubt on the existence of a second hypothetical planet.


title: Geometry of the signed support of a multivariate polynomial and Descartes' rule of signs

abstract: We describe conditions on the signed support, that is, on the set of the exponent vectors and on the signs of the coefficients, of a multivariate polynomial $f$ ensuring that the semi-algebraic set $\{ f < 0 \}$ defined in the positive orthant has at most one connected component. These results generalize Descartes' rule of signs in the sense that they provide a bound which is independent of the values of the coefficients and the degree of the polynomial. Based on how the exponent vectors lie on the faces of the Newton polytope, we give a recursive algorithm that verifies a sufficient condition for the set $\{ f < 0 \}$ to have one connected component. We apply the algorithm to reaction networks in order to prove that the parameter region of multistationarity of a ubiquitous network comprising phosphorylation cycles is connected.


title: Temporal Convolutional Explorer Helps Understand 1D-CNN's Learning Behavior in Time Series Classification from Frequency Domain

abstract: While one-dimensional convolutional neural networks (1D-CNNs) have been empirically proven effective in time series classification tasks, we find that there remain undesirable outcomes that could arise in their application, motivating us to further investigate and understand their underlying mechanisms. In this work, we propose a Temporal Convolutional Explorer (TCE) to empirically explore the learning behavior of 1D-CNNs from the perspective of the frequency domain. Our TCE analysis highlights that deeper 1D-CNNs tend to distract the focus from the low-frequency components leading to the accuracy degradation phenomenon, and the disturbing convolution is the driving factor. Then, we leverage our findings to the practical application and propose a regulatory framework, which can easily be integrated into existing 1D-CNNs. It aims to rectify the suboptimal learning behavior by enabling the network to selectively bypass the specified disturbing convolutions. Finally, through comprehensive experiments on widely-used UCR, UEA, and UCI benchmarks, we demonstrate that 1) TCE's insight into 1D-CNN's learning behavior; 2) our regulatory framework enables state-of-the-art 1D-CNNs to get improved performances with less consumption of memory and computational overhead.


title: ExIFFI and EIF+: Interpretability and Enhanced Generalizability to Extend the Extended Isolation Forest

abstract: Anomaly Detection involves identifying unusual behaviors within complex datasets and systems. While Machine Learning algorithms and Decision Support Systems (DSSs) offer effective solutions for this task, simply pinpointing anomalies may prove insufficient in real-world applications. Users require insights into the rationale behind these predictions to facilitate root cause analysis and foster trust in the model. However, the unsupervised nature of AD presents a challenge in developing interpretable tools. This paper addresses this challenge by introducing ExIFFI, a novel interpretability approach specifically designed to explain the predictions made by Extended Isolation Forest. ExIFFI leverages feature importance to provide explanations at both global and local levels. This work also introduces EIF+, an enhanced variant of Extended Isolation Forest, conceived to improve its generalization capabilities through a different splitting hyperplanes design strategy. A comprehensive comparative analysis is conducted, employing both synthetic and real-world datasets to evaluate various unsupervised AD approaches. The analysis demonstrates the effectiveness of ExIFFI in providing explanations for AD predictions. Furthermore, the paper explores the utility of ExIFFI as a feature selection technique in unsupervised settings. Finally, this work contributes to the research community by providing open-source code, facilitating further investigation and reproducibility.


title: Learning to Predict Structural Vibrations

abstract: In mechanical structures like airplanes, cars and houses, noise is generated and transmitted through vibrations. To take measures to reduce this noise, vibrations need to be simulated with expensive numerical computations. Surrogate deep learning models present a promising alternative to classical numerical simulations as they can be evaluated magnitudes faster, while trading-off accuracy. To quantify such trade-offs systematically and foster the development of methods, we present a benchmark on the task of predicting the vibration of harmonically excited plates. The benchmark features a total of 12000 plate geometries with varying forms of beadings, material and sizes with associated numerical solutions. To address the benchmark task, we propose a new network architecture, named Frequency-Query Operator, which is trained to map plate geometries to their vibration pattern given a specific excitation frequency. Applying principles from operator learning and implicit models for shape encoding, our approach effectively addresses the prediction of highly variable frequency response functions occurring in dynamic systems. To quantify the prediction quality, we introduce a set of evaluation metrics and evaluate the method on our vibrating-plates benchmark. Our method outperforms DeepONets, Fourier Neural Operators and more traditional neural network architectures. Code, dataset and visualizations: https://eckerlab.org/code/delden2023_plate


title: Generative Judge for Evaluating Alignment

abstract: The rapid development of Large Language Models (LLMs) has substantially expanded the range of tasks they can address. In the field of Natural Language Processing (NLP), researchers have shifted their focus from conventional NLP tasks (e.g., sequence tagging and parsing) towards tasks that revolve around aligning with human needs (e.g., brainstorming and email writing). This shift in task distribution imposes new requirements on evaluating these aligned models regarding generality (i.e., assessing performance across diverse scenarios), flexibility (i.e., examining under different protocols), and interpretability (i.e., scrutinizing models with explanations). In this paper, we propose a generative judge with 13B parameters, Auto-J, designed to address these challenges. Our model is trained on user queries and LLM-generated responses under massive real-world scenarios and accommodates diverse evaluation protocols (e.g., pairwise response comparison and single-response evaluation) with well-structured natural language critiques. To demonstrate the efficacy of our approach, we construct a new testbed covering 58 different scenarios. Experimentally, Auto-J outperforms a series of strong competitors, including both open-source and closed-source models, by a large margin. We also provide detailed analysis and case studies to further reveal the potential of our method and make a variety of resources public at https://github.com/GAIR-NLP/auto-j.


title: Drawn Tree Decomposition: New Approach for Graph Drawing Problems

abstract: Over the past decade, we witness an increasing amount of interest in the design of exact exponential-time and parameterized algorithms for problems in Graph Drawing. Unfortunately, we still lack knowledge of general methods to develop such algorithms. An even more serious issue is that, here, "standard" parameters very often yield intractability. In particular, for the most common structural parameter, namely, treewidth, we frequently observe NP-hardness already when the input graphs are restricted to have constant (often, being just $1$ or $2$) treewidth. Our work deals with both drawbacks simultaneously. We introduce a novel form of tree decomposition that, roughly speaking, does not decompose (only) a graph, but an entire drawing. As such, its bags and separators are of geometric (rather than only combinatorial) nature. While the corresponding parameter -- like treewidth -- can be arbitrarily smaller than the height (and width) of the drawing, we show that -- unlike treewidth -- it gives rise to efficient algorithms. Specifically, we get slice-wise polynomial (XP) time algorithms parameterized by our parameter. We present a general scheme for the design of such algorithms, and apply it to several central problems in Graph Drawing, including the recognition of grid graphs, minimization of crossings and bends, and compaction. Other than for the class of problems we discussed in the paper, we believe that our decomposition and scheme are of independent interest and can be further extended or generalized to suit even a wider class of problems. Additionally, we discuss classes of drawings where our parameter is bounded by $O(\sqrt{n})$ (where $n$ is the number of vertices of the graph), yielding subexponential-time algorithms. Lastly, we prove which relations exist between drawn treewidth and other width measures, including treewidth, pathwidth, (dual) carving-width and embedded-width.


title: Intelligent Tutoring System: Experience of Linking Software Engineering and Programming Teaching

abstract: The increasing number of computer science students pushes lecturers and tutors of first-year programming courses to their limits to provide high-quality feedback to the students. Existing systems that handle automated grading primarily focus on the automation of test case executions in the context of programming assignments. However, they cannot provide customized feedback about the students' errors, and hence, cannot replace the help of tutors. While recent research works in the area of automated grading and feedback generation address this issue by using automated repair techniques, so far, to the best of our knowledge, there has been no real-world deployment of such techniques. Based on the research advances in recent years, we have built an intelligent tutoring system that has the capability of providing automated feedback and grading. Furthermore, we designed a Software Engineering course that guides third-year undergraduate students in incrementally developing such a system over the coming years. Each year, students will make contributions that improve the current implementation, while at the same time, we can deploy the current system for usage by first year students. This paper describes our teaching concept, the intelligent tutoring system architecture, and our experience with the stakeholders. This software engineering project for the students has the key advantage that the users of the system are available in-house (i.e., students, tutors, and lecturers from the first-year programming courses). This helps organize requirements engineering sessions and builds awareness about their contribution to a "to be deployed" software project. In this multi-year teaching effort, we have incrementally built a tutoring system that can be used in first-year programming courses. Further, it represents a platform that can integrate the latest research results in APR for education.


title: Sentence-level Prompts Benefit Composed Image Retrieval

abstract: Composed image retrieval (CIR) is the task of retrieving specific images by using a query that involves both a reference image and a relative caption. Most existing CIR models adopt the late-fusion strategy to combine visual and language features. Besides, several approaches have also been suggested to generate a pseudo-word token from the reference image, which is further integrated into the relative caption for CIR. However, these pseudo-word-based prompting methods have limitations when target image encompasses complex changes on reference image, e.g., object removal and attribute modification. In this work, we demonstrate that learning an appropriate sentence-level prompt for the relative caption (SPRC) is sufficient for achieving effective composed image retrieval. Instead of relying on pseudo-word-based prompts, we propose to leverage pretrained V-L models, e.g., BLIP-2, to generate sentence-level prompts. By concatenating the learned sentence-level prompt with the relative caption, one can readily use existing text-based image retrieval models to enhance CIR performance. Furthermore, we introduce both image-text contrastive loss and text prompt alignment loss to enforce the learning of suitable sentence-level prompts. Experiments show that our proposed method performs favorably against the state-of-the-art CIR methods on the Fashion-IQ and CIRR datasets. The source code and pretrained model are publicly available at https://github.com/chunmeifeng/SPRC


title: How much do neutrinos live and weigh?

abstract: The next-generation water Cherenkov Hyper-Kamiokande detector will be able to detect thousands of neutrino events from a galactic Supernova explosion via Inverse Beta Decay processes followed by neutron capture on Gadolinium. This superb statistics provides a unique window to set bounds on neutrino properties, as its mass and lifetime. We shall explore the capabilities of such a future detector, constraining the former two properties via the time delay and the flux suppression induced in the Supernovae neutrino time and energy spectra. Special attention will be devoted to the statistically sub-dominant elastic scattering induced events, normally neglected, which can substantially improve the neutrino mass bound via time delays. When allowing for a invisible decaying scenario, the $95\%~$C.L. lower bound on $\tau/m$ is almost one order of magnitude better than the one found with SN1987A neutrino events. Simultaneous limits can be set on both $m_\nu$ and $\tau_{\nu}$, combining the neutrino flux suppression with the time-delay signature: the best constrained lifetime is that of $\nu_1$, which has the richest electronic component. We find $\tau_{\nu_1}\gtrsim 4\times 10^5~$s at $95\%~$C.L. The tightest $95\%~$C.L. bound on the neutrino mass we find is $0.34~$eV, which is not only competitive with the tightest neutrino mass limits nowadays, but also comparable to future laboratory direct mass searches. Both mass and lifetime limits are independent on the mass ordering, which makes our results very robust and relevant.


title: Affine Frequency Division Multiplexing With Index Modulation

abstract: Affine frequency division multiplexing (AFDM) is a new multicarrier technique based on chirp signals tailored for high-mobility communications, which can achieve full diversity. In this paper, we propose an index modulation (IM) scheme based on the framework of AFDM systems, named AFDM-IM. In the proposed AFDM-IM scheme, the information bits are carried by the activation state of the subsymbols in discrete affine Fourier (DAF) domain in addition to the conventional constellation symbols. To efficiently perform IM, we divide the subsymbols in DAF domain into several groups and consider both the localized and distributed strategies. An asymptotically tight upper bound on the average bit error rate (BER) of the maximum-likelihood detection in the existence of channel estimation errors is derived in closed-form. Computer simulations are carried out to evaluate the performance of the proposed AFDM-IM scheme, whose results corroborate its superiority over the benchmark schemes in the linear time-varying channels. We also evaluate the BER performance of the index and modulated bits for the AFDM-IM scheme with and without satisfying the full diversity condition of AFDM. The results show that the index bits have a stronger diversity protection than the modulated bits even when the full diversity condition of AFDM is not satisfied.


title: Revitalizing education through ict: a short overview of japan's current landscape

abstract: The domain of Information and Communication Technology (ICT) education has garnered significant consideration in recent times. However, several challenges are inherent to this area of study, including monetary expense, temporal factors, pedagogical environment, teacher training programs, incentive, syllabus design, and health-related concerns. This paper presents an analysis of the difficulties encountered in the realm of ICT education in Japan, taking into account ten different perspectives. A peer-reviewed article of this Preprint also exists "Fujita, T. (2023). REVITALIZING EDUCATION THROUGH ICT: A SHORT OVERVIEW OF JAPAN'S CURRENT LANDSCAPE. European Journal of Social Sciences Studies, 8(5)."


title: Normalized solutions for a fractional $N/s$-Laplacian Choquard equation with exponential critical nonlinearities

abstract: In this paper, we are concerned with the following fractional $N/s$-Laplacian Choquard equation \begin{align*} \begin{cases} (-\Delta)^s_{N/s}u=\lambda |u|^{\frac{N}{s}-2}u +(I_\mu*F(u))f(u),\ \ \mbox{in}\ \mathbb{R}^N, \displaystyle\int_{\mathbb{R}^N}|u|^{N/s} \mathrm{d}x=a^{N/s}, \end{cases} \end{align*} where $s\in(0,1)$, $1<\frac{N}{s}\in \mathbb{N}^+$, $a>0$ is a prescribed constant, $\lambda\in \mathbb{R}$, $I_\mu(x)=\frac{1}{|x|^{\mu}}$ with $\mu\in(0,N)$, $F$ is the primitive function of $f$, and $f$ is a continuous function with exponential critical growth of Trudinger-Moser type. Under some suitable assumptions on $f$, we prove that the above problem admits a ground state solution for any given $a>0$, by using the constraint variational method and minimax technique.


title: Grease the gears for a steady microfluidic flow

abstract: Pumps are indispensable for analytical applications and ensure controlled fluid movement. Syringe pumps are among today_s most prevalent liquid delivery systems, especially for high-pressure, stable, low-flow-rate microfluidic applications. Due to moving mechanical parts of the assembly, regular maintenance is essential to ensure reliable operation and flow rates. However, lubrication of the mechanics is easily overlooked because the research focuses on novel analytical applications rather than on the maintenance of pumps. Here, we investigate the lubrication of the syringe pump guide rods with its effect on the flow rate stability after regular pump cleaning from contaminations. The guide rods of syringe pumps were thoroughly cleaned from any lubricant, and the flow rate for specified flowrates between 5 and 30 uL/min was measured, revealing tremendous flow rate fluctuations with a coefficient of variation (CV) value up to 0.34. In contrast, flow rate measurements of syringe pumps with lubricated guide rods show a five-fold smoother flow rate fluctuation depending on the specified flow rate with CV values below 0.07. In summary, we emphasize the awareness of lubricating moving parts of syringe pumps to achieve constant flow rates, minimize wear, and ensure the reliable operation of, for instance, accurate lab-on-a-chip workflows.

categories: physics.flu-dyn cs.SY eess.SY physics.app-ph


title: Deep Optimal Timing Strategies for Time Series

abstract: Deciding the best future execution time is a critical task in many business activities while evolving time series forecasting, and optimal timing strategy provides such a solution, which is driven by observed data. This solution has plenty of valuable applications to reduce the operation costs. In this paper, we propose a mechanism that combines a probabilistic time series forecasting task and an optimal timing decision task as a first systematic attempt to tackle these practical problems with both solid theoretical foundation and real-world flexibility. Specifically, it generates the future paths of the underlying time series via probabilistic forecasting algorithms, which does not need a sophisticated mathematical dynamic model relying on strong prior knowledge as most other common practices. In order to find the optimal execution time, we formulate the decision task as an optimal stopping problem, and employ a recurrent neural network structure (RNN) to approximate the optimal times. Github repository: \url{github.com/ChenPopper/optimal_timing_TSF}.


title: Collective Graph Exploration Parameterized by Vertex Cover

abstract: We initiate the study of the parameterized complexity of the {\sc Collective Graph Exploration} ({\sc CGE}) problem. In {\sc CGE}, the input consists of an undirected connected graph $G$ and a collection of $k$ robots, initially placed at the same vertex $r$ of $G$, and each one of them has an energy budget of $B$. The objective is to decide whether $G$ can be \emph{explored} by the $k$ robots in $B$ time steps, i.e., there exist $k$ closed walks in $G$, one corresponding to each robot, such that every edge is covered by at least one walk, every walk starts and ends at the vertex $r$, and the maximum length of any walk is at most $B$. Unfortunately, this problem is \textsf{NP}-hard even on trees [Fraigniaud {\em et~al.}, 2006]. Further, we prove that the problem remains \textsf{W[1]}-hard parameterized by $k$ even for trees of treedepth $3$. Due to the \textsf{para-NP}-hardness of the problem parameterized by treedepth, and motivated by real-world scenarios, we study the parameterized complexity of the problem parameterized by the vertex cover number ($\mathsf{vc}$) of the graph, and prove that the problem is fixed-parameter tractable (\textsf{FPT}) parameterized by $\mathsf{vc}$. Additionally, we study the optimization version of {\sc CGE}, where we want to optimize $B$, and design an approximation algorithm with an additive approximation factor of $O(\mathsf{vc})$.


title: Cabbage Sweeter than Cake? Analysing the Potential of Large Language Models for Learning Conceptual Spaces

abstract: The theory of Conceptual Spaces is an influential cognitive-linguistic framework for representing the meaning of concepts. Conceptual spaces are constructed from a set of quality dimensions, which essentially correspond to primitive perceptual features (e.g. hue or size). These quality dimensions are usually learned from human judgements, which means that applications of conceptual spaces tend to be limited to narrow domains (e.g. modelling colour or taste). Encouraged by recent findings about the ability of Large Language Models (LLMs) to learn perceptually grounded representations, we explore the potential of such models for learning conceptual spaces. Our experiments show that LLMs can indeed be used for learning meaningful representations to some extent. However, we also find that fine-tuned models of the BERT family are able to match or even outperform the largest GPT-3 model, despite being 2 to 3 orders of magnitude smaller.


title: Local Central Limit Theorem for Reflecting Diffusions in a Continuum Percolation Cluster

abstract: Reflecting diffusions on continuum percolation clusters are considered. Assuming that the occupied region has a unique unbounded cluster and the cluster satisfies geometrical conditions such as volume regularity, isoperimetric conditions, and a hole size condition, we prove a quenched local central limit theorem for reflecting diffusions on the cluster.


title: Geometry-Guided Ray Augmentation for Neural Surface Reconstruction with Sparse Views

abstract: In this paper, we propose a novel method for 3D scene and object reconstruction from sparse multi-view images. Different from previous methods that leverage extra information such as depth or generalizable features across scenes, our approach leverages the scene properties embedded in the multi-view inputs to create precise pseudo-labels for optimization without any prior training. Specifically, we introduce a geometry-guided approach that improves surface reconstruction accuracy from sparse views by leveraging spherical harmonics to predict the novel radiance while holistically considering all color observations for a point in the scene. Also, our pipeline exploits proxy geometry and correctly handles the occlusion in generating the pseudo-labels of radiance, which previous image-warping methods fail to avoid. Our method, dubbed Ray Augmentation (RayAug), achieves superior results on DTU and Blender datasets without requiring prior training, demonstrating its effectiveness in addressing the problem of sparse view reconstruction. Our pipeline is flexible and can be integrated into other implicit neural reconstruction methods for sparse views.


title: IDTraffickers: An Authorship Attribution Dataset to link and connect Potential Human-Trafficking Operations on Text Escort Advertisements

abstract: Human trafficking (HT) is a pervasive global issue affecting vulnerable individuals, violating their fundamental human rights. Investigations reveal that a significant number of HT cases are associated with online advertisements (ads), particularly in escort markets. Consequently, identifying and connecting HT vendors has become increasingly challenging for Law Enforcement Agencies (LEAs). To address this issue, we introduce IDTraffickers, an extensive dataset consisting of 87,595 text ads and 5,244 vendor labels to enable the verification and identification of potential HT vendors on online escort markets. To establish a benchmark for authorship identification, we train a DeCLUTR-small model, achieving a macro-F1 score of 0.8656 in a closed-set classification environment. Next, we leverage the style representations extracted from the trained classifier to conduct authorship verification, resulting in a mean r-precision score of 0.8852 in an open-set ranking environment. Finally, to encourage further research and ensure responsible data sharing, we plan to release IDTraffickers for the authorship attribution task to researchers under specific conditions, considering the sensitive nature of the data. We believe that the availability of our dataset and benchmarks will empower future researchers to utilize our findings, thereby facilitating the effective linkage of escort ads and the development of more robust approaches for identifying HT indicators.


title: Integration-free Training for Spatio-temporal Multimodal Covariate Deep Kernel Point Processes

abstract: In this study, we propose a novel deep spatio-temporal point process model, Deep Kernel Mixture Point Processes (DKMPP), that incorporates multimodal covariate information. DKMPP is an enhanced version of Deep Mixture Point Processes (DMPP), which uses a more flexible deep kernel to model complex relationships between events and covariate data, improving the model's expressiveness. To address the intractable training procedure of DKMPP due to the non-integrable deep kernel, we utilize an integration-free method based on score matching, and further improve efficiency by adopting a scalable denoising score matching method. Our experiments demonstrate that DKMPP and its corresponding score-based estimators outperform baseline models, showcasing the advantages of incorporating covariate information, utilizing a deep kernel, and employing score-based estimators.


title: On forwarding techniques for stabilization and set-point output regulation of semilinear infinite-dimensional systems

abstract: A stabilizer based on the forwarding technique is proposed for semilinear infinite-dimensional systems in cascade form. Sufficient conditions for local exponentially stability and global asymptotic stability of the closed-loop are derived. Results for the problem of local set-point output regulation are also obtained. Finally, an application to a system consisting of a flexible beam attached to a rotating joint is proposed.


title: Enumerating the faces of split matroid polytopes

abstract: This paper initiates the explicit study of face numbers of matroid polytopes and their computation. We prove that, for the large class of split matroid polytopes, their face numbers depend solely on the number of cyclic flats of each rank and size, together with information on the modular pairs of cyclic flats. We provide a formula which allows us to calculate $f$-vectors without the need of taking convex hulls or computing face lattices. We discuss the particular cases of sparse paving matroids and rank two matroids, which are of independent interest due to their appearances in other combinatorial and geometric settings.


title: Zero-Point Energy Density at the Origin of the Vacuum Permittivity and Photon Propagation Time Fluctuation

abstract: We give a vacuum description with zero-point density for virtual fluctuations. One of the goals is to explain the origin of the vacuum permittivity and permeability and to calculate their values. In particular, we improve on existing calculations by avoiding assumptions on the volume occupied by virtual fluctuations. We propose testing of the models that assume a finite lifetime of virtual fluctuation. If during its propagation, the photon is stochastically trapped and released by virtual pairs, the propagation velocity may fluctuate. The propagation time fluctuation is estimated for several existing models. The obtained values are measurable with available technologies involving ultra-short laser pulses, and some of the models are already in conflict with the existing astronomical observations. The phase velocity is not affected significantly, which is consistent with the interferometric measurements.


title: Some extensions of the $\phi$-divergence moment closures for the radiative transfer equation

abstract: The $\phi$-divergence-based moment method was recently introduced Abdelmalik et al. (2023) for the discretization of the radiative transfer equation. At the continuous level, this method is very close to the entropy-based MN methods and possesses its main properties, i.e. entropy dissipation, rotational invariance and energy conservation. However, the $\phi$-divergence based moment systems are easier to resolve numerically due to the improved conditioning of the discrete equations. Moreover, exact quadrature rules can be used to compute moments of the distribution function, which enables the preservation of energy conservation, entropy dissipation and rotational invariants, discretely. In this paper we consider different variants of the $\phi$-divergence closures that are based on different approximations of the exponential function and the Planck function. We compare the approximation properties of the proposed closures in the numerical benchmarks.


title: Dynamic wetting experiment with nitrogen in a quasi-capillary tube

abstract: This work investigates the wetting dynamics of cryogenic fluids in inertia-dominated conditions. We experimentally characterized an oscillating gas-liquid interface of liquid nitrogen in a partially filled U-shaped quartz tube. The experiments were carried out in controlled cryogenic conditions, with interface oscillations produced by releasing the liquid column from an unbalanced position and having nitrogen vapor as the only ullage gas. During the experiments, the interface shape was tracked via image processing and used to fit a model from which the contact angle could be accurately determined. The results show that the dynamic contact angle evolution in advancing conditions is linearly linked to the Capillary number, with a slope depending on whether the interface moves over a dry or a pre-wet surface. However, the contact angle remains close to the one at equilibrium in receding conditions. To analyze the relation between contact angle and interface dynamics, we define an equivalent contact angle as the one that would make a spherical interface produce the same capillary pressure drop as the actual interface shape. The evolution of this equivalent contact angle proved to be independent of the evolution of the actual one, suggesting that the interface shape is not influenced by it. Finally, a theoretical analysis of the interface motion using a simplified model shows that viscous forces dominate the damping of the interface for small tube sizes, while gravity and inertial forces dominate the oscillating dynamics of the liquid column for larger tubes.


title: Complete determination of $SU(3)_F$ amplitudes and strong phase in $\Lambda_c^+ \to \Xi^0 K^+$

abstract: The BESIII collaboration has recently reported the first time measurement of the decay asymmetry $\alpha(\Lambda_c^+ \to \Xi^0 K^+) = 0.01 \pm 0.16(stat.) \pm 0.03(syst.)$ and also a sizable phase shift of $\delta_P-\delta_S = -1.55 \pm 0.25$ or $1.59\pm 0.25$ between S- and P-wave amplitudes. This implies significant strong phase shifts in the decay amplitudes. The strong phases indicate the existence of rescattering or loop effects, which are challenging to calculate due to non-perturbative effects. By employing the flavor $SU(3)_F$ symmetry and applying the K\"orner-Pati-Woo theorem to reduce the number of parameters, we find that the current data already allow us to obtain, for the first time, model-independent decay amplitudes and their strong phases. The establishment of the existence of sizable strong phases opens a window for future investigations into CP violation. In our fit, a notable discrepancy emerges in the branching ratio of $\Xi_c^0 \to \Xi^- \pi^+$. The direct relationship between $\Gamma (\Lambda_c^+ \to \Lambda e^+\nu_e)$ and $\Gamma (\Xi_c^0 \to \Xi^- e^+\nu_e)$, along with newly discovered $SU(3)_F$ relations, collectively suggests an underestimation of $\mathcal{B}(\Xi_c^0 \to \Xi^- \pi^+)$ in experimental findings.


title: How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Composition

abstract: Large language models (LLMs) with enormous pre-training tokens and parameters emerge diverse abilities, including math reasoning, code generation, and instruction following. These abilities are further enhanced by supervised fine-tuning (SFT). While the open-source community has explored ad-hoc SFT for enhancing individual capabilities, proprietary LLMs exhibit versatility across various skills. Therefore, understanding the facilitation of multiple abilities via SFT is paramount. In this study, we specifically focuses on the interplay of data composition between mathematical reasoning, code generation, and general human-aligning abilities during SFT. We propose four intriguing research questions to explore the association between model performance and various factors including data amount, composition ratio, model size and SFT strategies. Our experiments reveal that distinct capabilities scale differently and larger models generally show superior performance with same amount of data. Mathematical reasoning and code generation consistently improve with increasing data amount, whereas general abilities plateau after roughly a thousand samples. Moreover, we observe data composition appears to enhance various abilities under limited data conditions, yet can lead to performance conflicts when data is plentiful. Our findings also suggest the amount of composition data influences performance more than the composition ratio. In analysis of SFT strategies, we find that sequentially learning multiple skills risks catastrophic forgetting. Our proposed Dual-stage Mixed Fine-tuning (DMT) strategy offers a promising solution to learn multiple abilities with different scaling patterns.


title: An Adaptable IoT Rule Engine Framework for Dataflow Monitoring and Control Strategies

abstract: The monitoring of data generated by a large number of devices in Internet of Things (IoT) systems is an important and complex issue. Several studies have explored the use of generic rule engine, primarily based on the RETE algorithm, for monitoring the flow of device data. In order to solve the performance problem of the RETE algorithm in IoT scenarios, some studies have also proposed improved RETE algorithms. However, implementing modifications to the general rule engine remains challenges in practical applications. The Thingsboard open-source platform introduces an IoT-specific rule engine that does not rely on the RETE algorithm. Its interactive mode attracted attention from developers and researchers. However, the close integration between its rule module and the platform, as well as the difficulty in formulating rules for multiple devices, limits its flexibility. This paper presents an adaptable and user-friendly rule engine framework for monitoring and control IoT device data flows. The framework is easily extensible and allows for the formulation of rules contain multiple devices. We designed a Domain-Specific Language (DSL) for rule description. A prototype system of this framework was implemented to verify the validity of theoretical method. The framework has potential to be adaptable to a wide range of IoT scenarios and is especially effective in where real-time control demands are not as strict.


title: Finding a Minimum Spanning Tree with a Small Non-Terminal Set

abstract: In this paper, we study the problem of finding a minimum weight spanning tree that contains each vertex in a given subset $V_{\rm NT}$ of vertices as an internal vertex. This problem, called Minimum Weight Non-Terminal Spanning Tree, includes $s$-$t$ Hamiltonian Path as a special case, and hence it is NP-hard. In this paper, we first observe that Non-Terminal Spanning Tree, the unweighted counterpart of Minimum Weight Non-Terminal Spanning Tree, is already NP-hard on some special graph classes. Moreover, it is W[1]-hard when parameterized by clique-width. In contrast, we give a $3k$-vertex kernel and $O^*(2^k)$-time algorithm, where $k$ is the size of non-terminal set $V_{\rm NT}$. The latter algorithm can be extended to Minimum Weight Non-Terminal Spanning Tree with the restriction that each edge has a polynomially bounded integral weight. We also show that Minimum Weight Non-Terminal Spanning Tree is fixed-parameter tractable parameterized by the number of edges in the subgraph induced by the non-terminal set $V_{\rm NT}$, extending the fixed-parameter tractability of Minimum Weight Non-Terminal Spanning Tree to the general case. Finally, we give several results for structural parameterization.


title: On the Convergence of Federated Averaging under Partial Participation for Over-parameterized Neural Networks

abstract: Federated learning (FL) is a widely employed distributed paradigm for collaboratively training machine learning models from multiple clients without sharing local data. In practice, FL encounters challenges in dealing with partial client participation due to the limited bandwidth, intermittent connection and strict synchronized delay. Simultaneously, there exist few theoretical convergence guarantees in this practical setting, especially when associated with the non-convex optimization of neural networks. To bridge this gap, we focus on the training problem of federated averaging (FedAvg) method for two canonical models: a deep linear network and a two-layer ReLU network. Under the over-parameterized assumption, we provably show that FedAvg converges to a global minimum at a linear rate $\mathcal{O}\left((1-\frac{min_{i \in [t]}|S_i|}{N^2})^t\right)$ after $t$ iterations, where $N$ is the number of clients and $|S_i|$ is the number of the participated clients in the $i$-th iteration. Experimental evaluations confirm our theoretical results.


title: A resolved study of the inner regions of nearby galaxies with an excess of young massive stars: missing link in the AGN-starburst connection?

abstract: We have selected galaxies with very high levels of H$\alpha$ emission (EQW(H$\alpha$)$>$700 \AA.) in their central regions from the final data release of the MaNGA survey . Our study focuses on 14 very well-resolved nearby galaxies with stellar masses in the range $9.5 < \log M_*/(M_{\odot}) < 11.5$. We investigate a variety of procedures for selecting galaxy regions that are likely to harbour excess populations of young massive stars, finding that selection in the 2-dimensional space of extinction-corrected H$\alpha$ EQW and [SIII]/[SII] line ratio produces the best results. By comparing stacked spectra covering these regions with stacked spectra covering normal starburst regions with 100\AA$<$EQW(H$\alpha$)$<$200\AA, we obtain the following main results: 1) Clear signatures of excess Wolf Rayet stars are found in half of the H$\alpha$ excess regions, 2) Galaxy regions containing excess Wolf Rayet stars are more often associated with the presence of high-ionization emission lines characteristic of accreting black holes. Excess [NeIII] is detected in 4 out of 8 of the WR regions and there are tentative [FeX] detections in 2 galaxies. 3) Regions of the galaxy with excess Wolf Rayet stars are located where the interstellar medium has larger ionized gas turbulent velocities and higher neutral gas overdensities. We make a first attempt to constrain changes in the high mass end of the stellar initial mass function (IMF) using the HR-pyPopStar evolutionary population synthesis models that include high wavelength-resolution theoretical atmosphere libraries for Wolf Rayet stars.


title: A proposal for imaging spectro-polarimetry with a new generation Multichannel Subtractive Double Pass (MSDP) onboard the EST telescope

abstract: Imaging spectroscopy is intended to be coupled with adaptive optics (AO) on large telescopes, such as EST, in order to produce high spatial and temporal resolution measurements of velocities and magnetic fields upon a 2D FOV. We propose a Multichannel Subtractive Double Pass (MSDP) incorporated to the EST visible and IR spectrographs, using new generation slicers (56 channels, high spectral resolution) which will benefit of AO and polarimeters. The aim is to produce 56-channel spectra images with the spatial resolution of the AO and reconstitute cubes of instantaneous data (X, Y, lambda) at high cadence, allowing the study of the plasma dynamics and magnetic fields. The MSDP is compatible with most polarimetric methods (we shall discuss only two of them).


title: Semi-Supervised Object Detection with Uncurated Unlabeled Data for Remote Sensing Images

abstract: Annotating remote sensing images (RSIs) presents a notable challenge due to its labor-intensive nature. Semi-supervised object detection (SSOD) methods tackle this issue by generating pseudo-labels for the unlabeled data, assuming that all classes found in the unlabeled dataset are also represented in the labeled data. However, real-world situations introduce the possibility of out-of-distribution (OOD) samples being mixed with in-distribution (ID) samples within the unlabeled dataset. In this paper, we delve into techniques for conducting SSOD directly on uncurated unlabeled data, which is termed Open-Set Semi-Supervised Object Detection (OSSOD). Our approach commences by employing labeled in-distribution data to dynamically construct a class-wise feature bank (CFB) that captures features specific to each class. Subsequently, we compare the features of predicted object bounding boxes with the corresponding entries in the CFB to calculate OOD scores. We design an adaptive threshold based on the statistical properties of the CFB, allowing us to filter out OOD samples effectively. The effectiveness of our proposed method is substantiated through extensive experiments on two widely used remote sensing object detection datasets: DIOR and DOTA. These experiments showcase the superior performance and efficacy of our approach for OSSOD on RSIs.


title: Integrating Graphs with Large Language Models: Methods and Prospects

abstract: Large language models (LLMs) such as GPT-4 have emerged as frontrunners, showcasing unparalleled prowess in diverse applications, including answering queries, code generation, and more. Parallelly, graph-structured data, an intrinsic data type, is pervasive in real-world scenarios. Merging the capabilities of LLMs with graph-structured data has been a topic of keen interest. This paper bifurcates such integrations into two predominant categories. The first leverages LLMs for graph learning, where LLMs can not only augment existing graph algorithms but also stand as prediction models for various graph tasks. Conversely, the second category underscores the pivotal role of graphs in advancing LLMs. Mirroring human cognition, we solve complex tasks by adopting graphs in either reasoning or collaboration. Integrating with such structures can significantly boost the performance of LLMs in various complicated tasks. We also discuss and propose open questions for integrating LLMs with graph-structured data for the future direction of the field.


title: Relative Fluid Stretching and Rotation for Sparse Trajectory Observations

abstract: As most mathematically justifiable Lagrangian coherent structure detection methods rely on spatial derivatives, their applicability to sparse trajectory data has been limited. For experimental fluid dynamicists and natural scientists working with Lagrangian trajectory data via passive tracers in unsteady flows (e.g. Lagrangian particle tracking or ocean buoys), obtaining material measures of fluid rotation or stretching is currently only possible for trajectory concentrations that are often out-of-reach. To facilitate frame-indifferent investigations in unsteady and sparsely sampled flows, we present a novel approach to quantify fluid stretching and rotation via relative Lagrangian velocities. This technique provides a formal objective extension of quasi-objective metrics to unsteady flows by accounting for mean flow behavior. For extremely sparse experimental data, fluid structures may be significantly undersampled, and the mean flow behavior becomes difficult to quantify. We provide a means to maintain the accuracy of our novel sparse flow diagnostics in extremely sparse sampling scenarios, such as ocean buoy data and Lagrangian particle tracking. We use data from multiple numerical and experimental flows to show that our methods can identify structures beyond existing limits of sparse, frame-indifferent diagnostics, and exhibit improved interpretability over common frame-dependent diagnostics.


title: Inexact Newton methods with matrix approximation by sampling for nonlinear least-squares and systems

abstract: We develop and analyze stochastic inexact Gauss-Newton methods for nonlinear least-squares problems and inexact Newton methods for nonlinear systems of equations. Random models are formed using suitable sampling strategies for the matrices involved in the deterministic models. The analysis of the expected number of iterations needed in the worst case to achieve a desired level of accuracy in the first-order optimality condition provides guidelines for applying sampling and enforcing, with fixed probability, a suitable accuracy in the random approximations. Results of the numerical validation of the algorithms are presented.


title: XAL: EXplainable Active Learning Makes Classifiers Better Low-resource Learners

abstract: Active learning (AL), which aims to construct an effective training set by iteratively curating the most formative unlabeled data for annotation, has been widely used in low-resource tasks. Most active learning techniques in classification rely on the model's uncertainty or disagreement to choose unlabeled data, suffering from the problem of over-confidence in superficial patterns and a lack of exploration. Inspired by the cognitive processes in which humans deduce and predict through causal information, we take an initial attempt towards integrating rationales into AL and propose a novel Explainable Active Learning framework (XAL) for low-resource text classification, which aims to encourage classifiers to justify their inferences and delve into unlabeled data for which they cannot provide reasonable explanations. Specifically, besides using a pre-trained bi-directional encoder for classification, we employ a pre-trained uni-directional decoder to generate and score the explanation. We further facilitate the alignment of the model with human reasoning preference through a proposed ranking loss. During the selection of unlabeled data, the predicted uncertainty of the encoder and the explanation score of the decoder complement each other as the final metric to acquire informative data. Extensive experiments on six datasets show that XAL achieves consistent improvement over 9 strong baselines. Analysis indicates that the proposed method can generate corresponding explanations for its predictions.


title: Do We Observe Dark Photons in PHELEX with a Multi-Cathode Counter?

abstract: In this paper, we report the results obtained in the PHoton ELectron EXperiment (PHELEX) during 208 days of measurements in the search for dark photons using a multi-cathode counter with an iron cathode. We observed a systematic excess of single-electron events in four runs, with a confidence level better than 5 sigma, in the time interval from 8-00 to 12-00 in sidereal time. The fact that we observe this effect in the stellar frame while detecting the excess of count rate in the solar frame in different time intervals is evidence that this effect is of galactic origin. This strengthens our argument that we are indeed observing the effect of dark photons


title: Colmap-PCD: An Open-source Tool for Fine Image-to-point cloud Registration

abstract: State-of-the-art techniques for monocular camera reconstruction predominantly rely on the Structure from Motion (SfM) pipeline. However, such methods often yield reconstruction outcomes that lack crucial scale information, and over time, accumulation of images leads to inevitable drift issues. In contrast, mapping methods based on LiDAR scans are popular in large-scale urban scene reconstruction due to their precise distance measurements, a capability fundamentally absent in visual-based approaches. Researchers have made attempts to utilize concurrent LiDAR and camera measurements in pursuit of precise scaling and color details within mapping outcomes. However, the outcomes are subject to extrinsic calibration and time synchronization precision. In this paper, we propose a novel cost-effective reconstruction pipeline that utilizes a pre-established LiDAR map as a fixed constraint to effectively address the inherent scale challenges present in monocular camera reconstruction. To our knowledge, our method is the first to register images onto the point cloud map without requiring synchronous capture of camera and LiDAR data, granting us the flexibility to manage reconstruction detail levels across various areas of interest. To facilitate further research in this domain, we have released Colmap-PCD${^{3}}$, an open-source tool leveraging the Colmap algorithm, that enables precise fine-scale registration of images to the point cloud map.


title: AbCD: A Component-wise Adjustable Framework for Dynamic Optimization Problems

abstract: Dynamic Optimization Problems (DOPs) are characterized by changes in the fitness landscape that can occur at any time and are common in real world applications. The main issues to be considered include detecting the change in the fitness landscape and reacting in accord. Over the years, several evolutionary algorithms have been proposed to take into account this characteristic during the optimization process. However, the number of available tools or open source codebases for these approaches is limited, making reproducibility and extensive experimentation difficult. To solve this, we developed a component-oriented framework for DOPs called Adjustable Components for Dynamic Problems (AbCD), inspired by similar works in the Multiobjective static domain. Using this framework, we investigate components that were proposed in several popular DOP algorithms. Our experiments show that the performance of these components depends on the problem and the selected components used in a configuration, which differs from the results reported in the literature. Using irace, we demonstrate how this framework can automatically generate DOP algorithm configurations that take into account the characteristics of the problem to be solved. Our results highlight existing problems in the DOP field that need to be addressed in the future development of algorithms and components.


title: Query and Response Augmentation Cannot Help Out-of-domain Math Reasoning Generalization

abstract: In math reasoning with large language models (LLMs), fine-tuning data augmentation by query evolution and diverse reasoning paths is empirically verified effective, profoundly narrowing the gap between open-sourced LLMs and cutting-edge proprietary LLMs. In this paper, we conduct an investigation for such data augmentation in math reasoning and are intended to answer: (1) What strategies of data augmentation are more effective; (2) What is the scaling relationship between the amount of augmented data and model performance; and (3) Can data augmentation incentivize generalization to out-of-domain mathematical reasoning tasks? To this end, we create a new dataset, AugGSM8K, by complicating and diversifying the queries from GSM8K and sampling multiple reasoning paths. We obtained a series of LLMs called MuggleMath by fine-tuning on subsets of AugGSM8K. MuggleMath substantially achieves new state-of-the-art on GSM8K (from 54% to 68.4% at the scale of 7B, and from 63.9% to 74.0% at the scale of 13B). A log-linear relationship is presented between MuggleMath's performance and the amount of augmented data. We also find that MuggleMath is weak in out-of-domain math reasoning generalization to MATH. This is attributed to the differences in query distribution between AugGSM8K and MATH which suggest that augmentation on a single benchmark could not help with overall math reasoning performance. Codes and AugGSM8K will be uploaded to https://github.com/OFA-Sys/gsm8k-ScRel.


title: MEDUSA: Scalable Biometric Sensing in the Wild through Distributed MIMO Radars

abstract: Radar-based techniques for detecting vital signs have shown promise for continuous contactless vital sign sensing and healthcare applications. However, real-world indoor environments face significant challenges for existing vital sign monitoring systems. These include signal blockage in non-line-of-sight (NLOS) situations, movement of human subjects, and alterations in location and orientation. Additionally, these existing systems failed to address the challenge of tracking multiple targets simultaneously. To overcome these challenges, we present MEDUSA, a novel coherent ultra-wideband (UWB) based distributed multiple-input multiple-output (MIMO) radar system, especially it allows users to customize and disperse the $16 \times 16$ into sub-arrays. MEDUSA takes advantage of the diversity benefits of distributed yet wirelessly synchronized MIMO arrays to enable robust vital sign monitoring in real-world and daily living environments where human targets are moving and surrounded by obstacles. We've developed a scalable, self-supervised contrastive learning model which integrates seamlessly with our hardware platform. Each attention weight within the model corresponds to a specific antenna pair of Tx and Rx. The model proficiently recovers accurate vital sign waveforms by decomposing and correlating the mixed received signals, including comprising human motion, mobility, noise, and vital signs. Through extensive evaluations involving 21 participants and over 200 hours of collected data (3.75 TB in total, with 1.89 TB for static subjects and 1.86 TB for moving subjects), MEDUSA's performance has been validated, showing an average gain of 20% compared to existing systems employing COTS radar sensors. This demonstrates MEDUSA's spatial diversity gain for real-world vital sign monitoring, encompassing target and environmental dynamics in familiar and unfamiliar indoor environments.


title: A Comparison between Markov Chain and Koopman Operator Based Data-Driven Modeling of Dynamical Systems

abstract: Markov chain-based modeling and Koopman operator-based modeling are two popular frameworks for data-driven modeling of dynamical systems. They share notable similarities from a computational and practitioner's perspective, especially for modeling autonomous systems. The first part of this paper aims to elucidate these similarities. For modeling systems with control inputs, the models produced by the two approaches differ. The second part of this paper introduces these models and their corresponding control design methods. We illustrate the two approaches and compare them in terms of model accuracy and computational efficiency for both autonomous and controlled systems in numerical examples.


title: Quartic rigid systems in the plane and in the Poincar\'e sphere

abstract: We consider the planar family of rigid systems of the form $x'=-y+xP(x,y), y'=x+yP(x,y)$, where $P$ is any polynomial with monomials of degree one and three. This is the simplest non-trivial family of rigid systems with no rotatory parameters. The family can be compactified to the Poincar\'e sphere such that the vector field along the equator is not identically null. We study the centers, singular points and limit cycles of that family on the plane and on the sphere.


title: The effect of Anderson localization on surface plasmon polariton propagation and outward leakage when scattered by a randomly corrugated section of the interface

abstract: The practical applications of surface plasmon polaritons (SPPs) require the deep understanding of the impact of electrical characteristics variability and geometrical irregularity of the metal-dielectric interface. Traditional methods in the theory of wave scattering at rough interfaces fail to treat simultaneously the interference (Anderson) localization of the SPP, which may arise due to its multiple back-scattering by random distortions of surface relief, and the leakage into the uniform dielectric half-space. In our previous works [Low Temp. Phys. \textbf{42}, 685 (2016); Ann.~Phys.~\textbf{455}, 169378 (2023)], by representing the perturbation of surface impedance as an effective potential in the Schr\"odinger-like equation, we suggested the way to describe the interplay between Anderson localization and the leakage of the SPP. In the present study we show that the problem of SPP scattering from finite geometrically rough region of the interface can be reduced to the problem of its scattering from the same region but with effective random impedance. We calculate the radiation pattern and demonstrate its pronounced anisotropy that arises due to the interplay between different geometrical parameters of the interface roughness.


title: Proposal-based Temporal Action Localization with Point-level Supervision

abstract: Point-level supervised temporal action localization (PTAL) aims at recognizing and localizing actions in untrimmed videos where only a single point (frame) within every action instance is annotated in training data. Without temporal annotations, most previous works adopt the multiple instance learning (MIL) framework, where the input video is segmented into non-overlapped short snippets, and action classification is performed independently on every short snippet. We argue that the MIL framework is suboptimal for PTAL because it operates on separated short snippets that contain limited temporal information. Therefore, the classifier only focuses on several easy-to-distinguish snippets instead of discovering the whole action instance without missing any relevant snippets. To alleviate this problem, we propose a novel method that localizes actions by generating and evaluating action proposals of flexible duration that involve more comprehensive temporal information. Moreover, we introduce an efficient clustering algorithm to efficiently generate dense pseudo labels that provide stronger supervision, and a fine-grained contrastive loss to further refine the quality of pseudo labels. Experiments show that our proposed method achieves competitive or superior performance to the state-of-the-art methods and some fully-supervised methods on four benchmarks: ActivityNet 1.3, THUMOS 14, GTEA, and BEOID datasets.


title: UAVs and Neural Networks for search and rescue missions

abstract: In this paper, we present a method for detecting objects of interest, including cars, humans, and fire, in aerial images captured by unmanned aerial vehicles (UAVs) usually during vegetation fires. To achieve this, we use artificial neural networks and create a dataset for supervised learning. We accomplish the assisted labeling of the dataset through the implementation of an object detection pipeline that combines classic image processing techniques with pretrained neural networks. In addition, we develop a data augmentation pipeline to augment the dataset with automatically labeled images. Finally, we evaluate the performance of different neural networks.


title: Findings of the 2023 ML-SUPERB Challenge: Pre-Training and Evaluation over More Languages and Beyond

abstract: The 2023 Multilingual Speech Universal Performance Benchmark (ML-SUPERB) Challenge expands upon the acclaimed SUPERB framework, emphasizing self-supervised models in multilingual speech recognition and language identification. The challenge comprises a research track focused on applying ML-SUPERB to specific multilingual subjects, a Challenge Track for model submissions, and a New Language Track where language resource researchers can contribute and evaluate their low-resource language data in the context of the latest progress in multilingual speech recognition. The challenge garnered 12 model submissions and 54 language corpora, resulting in a comprehensive benchmark encompassing 154 languages. The findings indicate that merely scaling models is not the definitive solution for multilingual speech tasks, and a variety of speech/voice types present significant challenges in multilingual speech processing.


title: Imaging the suppression of ferromagnetism in LaMnO$_3$ by metallic overlayers

abstract: LaMnO$_3$ (LMO) thin films epitaxially grown on SrTiO$_3$ (STO) usually exhibit ferromagnetism above a critical layer thickness. We report the use of scanning SQUID microscopy (SSM) to study the suppression of the ferromagnetism in STO/LMO/metal structures. By partially covering the LMO surface with a metallic layer, both covered and uncovered LMO regions can be studied simultaneously. While Au does not significantly influence the ferromagnetic order of the underlying LMO film, a thin Ti layer induces a strong suppression of the ferromagnetism, over tens of nanometers, which increases with time on a timescale of days. Detailed EELS analysis of the Ti-LaMnO$_3$ interface reveals \textcolor{black}{the presence of Mn$^{2+}$ and} an evolution of the Ti valence state from Ti$^0$ to Ti$^{4+}$ over approximately 5 nanometers. Furthermore, we demonstrate that by patterning Ti/Au overlayers, we can locally suppress the ferromagnetism and define ferromagnetic structures down to sub-micrometer scales.


title: Broadcast Channel Coding: Algorithmic Aspects and Non-Signaling Assistance

abstract: We address the problem of coding for classical broadcast channels, which entails maximizing the success probability that can be achieved by sending a fixed number of messages over a broadcast channel. For point-to-point channels, Barman and Fawzi found in~\cite{BF18} a $(1-e^{-1})$-approximation algorithm running in polynomial time, and showed that it is \textrm{NP}-hard to achieve a strictly better approximation ratio. Furthermore, these algorithmic results were at the core of the limitations they established on the power of non-signaling assistance for point-to-point channels. It is natural to ask if similar results hold for broadcast channels, exploiting links between approximation algorithms of the channel coding problem and the non-signaling assisted capacity region. In this work, we make several contributions on algorithmic aspects and non-signaling assisted capacity regions of broadcast channels. For the class of deterministic broadcast channels, we describe a $(1-e^{-1})^2$-approximation algorithm running in polynomial time, and we show that the capacity region for that class is the same with or without non-signaling assistance. Finally, we show that in the value query model, we cannot achieve a better approximation ratio than $\Omega\left(\frac{1}{\sqrt{m}}\right)$ in polynomial time for the general broadcast channel coding problem, with $m$ the size of one of the outputs of the channel.


title: Numerical simulations of the latest caldera-forming eruption of Okmok volcano, Alaska

abstract: The latest caldera-forming eruption of Okmok volcano, Alaska, had a global atmospheric impact with tephra deposits found in distant Arctic ice cores and a sulfate signal found in Antarctic ice cores. The associated large-scale climate cooling was driven by the amount of sulfur injected into the stratosphere during the climactic phase of the eruption. This phase was dominated by pyroclastic density currents, which have complex emplacement dynamics precluding direct estimates of the sulfur stratospheric load. We simulated the dynamics of this climactic phase with the two-phase flow model MFIX-TFM under axisymmetric conditions with several combinations of injection mass flux, emission duration, and topography. Results suggest that a steady mass flux of $8.6-28\times 10^9$ kg/s is consistent with field observations. Stratospheric injections occur in pulses issued from 1) the central plume initially rising above the caldera center, 2) successive co-ignimbrite clouds caused by the encounter of the pyroclastic density currents with topography, and 3) the buoyant lift-off of dilute parts of the currents at the end of the eruption. Overall, 2.5 to 25% of the emitted volcanic gas reaches the stratosphere if the mass flux at the vent is steady. A fluctuating emission rate or an efficient final lift-off due to seawater interaction were unlikely to have increased this loading. Combined with petrological estimates of the degassed S, our results suggest that the eruption emitted 46.5-60.4 Tg S into the troposphere and injected 1.6-15.5 Tg S into the stratosphere, which controlled the atmospheric forcing and the subsequent climate response.


title: WeatherGNN: Exploiting Meteo- and Spatial-Dependencies for Local Numerical Weather Prediction Bias-Correction

abstract: Due to insufficient local area information, numerical weather prediction (NWP) may yield biases for specific areas. Previous studies correct biases mainly by employing handcrafted features or applying data-driven methods intuitively, overlooking the complicated dependencies between weather factors and between areas. To address this issue, we propose WeatherGNN, a local NWP bias-correction method that utilizes Graph Neural Networks (GNNs) to exploit meteorological dependencies and spatial dependencies under the guidance of domain knowledge. Specifically, we introduce a factor GNN to capture area-specific meteorological dependencies adaptively based on spatial heterogeneity and a fast hierarchical GNN to capture dynamic spatial dependencies efficiently guided by Tobler's first and second laws of geography. Our experimental results on two real-world datasets demonstrate that WeatherGNN achieves the state-of-the-art performance, outperforming the best baseline with an average of 4.75 \% on RMSE.


title: On Double Descent in Reinforcement Learning with LSTD and Random Features

abstract: Temporal Difference (TD) algorithms are widely used in Deep Reinforcement Learning (RL). Their performance is heavily influenced by the size of the neural network. While in supervised learning, the regime of over-parameterization and its benefits are well understood, the situation in RL is much less clear. In this paper, we present a theoretical analysis of the influence of network size and $l_2$-regularization on performance. We identify the ratio between the number of parameters and the number of visited states as a crucial factor and define over-parameterization as the regime when it is larger than one. Furthermore, we observe a double descent phenomenon, i.e., a sudden drop in performance around the parameter/state ratio of one. Leveraging random features and the lazy training regime, we study the regularized Least-Square Temporal Difference (LSTD) algorithm in an asymptotic regime, as both the number of parameters and states go to infinity, maintaining a constant ratio. We derive deterministic limits of both the empirical and the true Mean-Squared Bellman Error (MSBE) that feature correction terms responsible for the double descent. Correction terms vanish when the $l_2$-regularization is increased or the number of unvisited states goes to zero. Numerical experiments with synthetic and small real-world environments closely match the theoretical predictions.


title: On symmetry adapted bases in trigonometric optimization

abstract: The problem of computing the global minimum of a trigonometric polynomial is computationally hard. We address this problem for the case, where the polynomial is invariant under the exponential action of a finite group. The strategy is to follow an established relaxation strategy in order to obtain a converging hierarchy of lower bounds. Those bounds are obtained by numerically solving semi-definite programs (SDPs) on the cone of positive semi-definite Hermitian Toeplitz matrices, which is outlined in the book of Dumitrescu [Dum07]. To exploit the invariance, we show that the group has an induced action on the Toeplitz matrices and prove that the feasible region of the SDP can be restricted to the invariant matrices, whilst retaining the same solution. Then we construct a symmetry adapted basis tailored to this group action, which allows us to block-diagonalize invariant matrices and thus reduce the computational complexity to solve the SDP. The approach is in its generality novel for trigonometric optimization and complements the one that was proposed as a poster at the ISSAC 2022 conference [HMMR22] and later extended to [HMMR24]. In the previous work, we first used the invariance of the trigonometric polynomial to obtain a classical polynomial optimization problem on the orbit space and subsequently relaxed the problem to an SDP. Now, we first make the relaxation and then exploit invariance. Partial results of this article have been presented as a poster at the ISSAC 2023 conference [Met23].


title: One Problem, One Solution: Unifying Robot and Environment Design Optimization

abstract: The task-specific optimization of robotic systems has long been divided into the optimization of the robot and the optimization of the environment. In this letter, we argue that these two problems are interdependent and should be treated as such. To this end, we present a unified problem formulation that enables for the simultaneous optimization of both the robot kinematics and the environment. We demonstrate the effectiveness of our approach by jointly optimizing a robotic milling system. To compare our approach to the state of the art we also optimize the robot kinematics and environment separately. The results show that our approach outperforms the state of the art and that simultaneous optimization leads to a much better solution.


title: The strong form of the Ahlfors-Schwarz lemma at the boundary and a rigidity result for Liouville's equation

abstract: We prove a boundary version of the strong form of the Ahlfors-Schwarz lemma with optimal error term. This result provides nonlinear extensions of the boundary Schwarz lemma of Burns and Krantz to the class of negatively curved conformal pseudometrics defined on arbitary hyperbolic domains in the complex plane. Based on a new boundary Harnack inequality for solutions of the Gauss curvature equation, we also establish a sharp rigidity result for conformal metrics with isolated singularities. In the particular case of constant negative curvature this strengthens classical results of Nitsche and Heins about Liouville's equation $\Delta u=e^u$.