title: Cut elimination for Zermelo set theory

abstract: We show how to express intuitionistic Zermelo set theory in deduction modulo (i.e. by replacing its axioms by rewrite rules) in such a way that the corresponding notion of proof enjoys the normalization property. To do so, we first rephrase set theory as a theory of pointed graphs (following a paradigm due to P. Aczel) by interpreting set-theoretic equality as bisimilarity, and show that in this setting, Zermelo's axioms can be decomposed into graph-theoretic primitives that can be turned into rewrite rules. We then show that the theory we obtain in deduction modulo is a conservative extension of (a minor extension of) Zermelo set theory. Finally, we prove the normalization of the intuitionistic fragment of the theory.


title: Artificial Intelligence for reverse engineering: application to detergents using Raman spectroscopy

abstract: The reverse engineering of a complex mixture, regardless of its nature, has become significant today. Being able to quickly assess the potential toxicity of new commercial products in relation to the environment presents a genuine analytical challenge. The development of digital tools (databases, chemometrics, machine learning, etc.) and analytical techniques (Raman spectroscopy, NIR spectroscopy, mass spectrometry, etc.) will allow for the identification of potential toxic molecules. In this article, we use the example of detergent products, whose composition can prove dangerous to humans or the environment, necessitating precise identification and quantification for quality control and regulation purposes. The combination of various digital tools (spectral database, mixture database, experimental design, Chemometrics / Machine Learning algorithm{\ldots}) together with different sample preparation methods (raw sample, or several concentrated / diluted samples) Raman spectroscopy, has enabled the identification of the mixture's constituents and an estimation of its composition. Implementing such strategies across different analytical tools can result in time savings for pollutant identification and contamination assessment in various matrices. This strategy is also applicable in the industrial sector for product or raw material control, as well as for quality control purposes.


title: Asymptotic normalization coefficients for $\alpha+ {}^{12}{\rm C}$ synthesis and the $S$-factor for ${}^{12}{\rm C}(\alpha, \,\gamma){}^{16}{\rm O}$ radiative capture

abstract: The $^{12}{\rm C}(\alpha,\gamma)^{16}$O reaction, determining the survival of carbon in red giants, is of interest for nuclear reaction theory and nuclear astrophysics. A specific feature of the $^{16}$O nuclear structure is the presence of two subthreshold bound states, (6.92 MeV, 2$^+$) and (7.12 MeV, 1$^-$), that dominate the behavior of the low-energy $S$-factor. The strength of these subthreshold states is determined by their asymptotic normalization coefficients (ANCs), which need to be known with high accuracy. Recently, using a model-independent extrapolation method, Blokhintsev {\it et al.} [Eur. Phys. J. A {\bf 59} (2023) 162] determined the ANCs for the $\alpha$-particle removal taking into account three subthreshold states in $^{16}$O. The goal of this paper is to address four main problems elucidating the impact of the subthreshold ANCs on the low-energy $S$-factor. Firstly, we analyse the connection between variations of the subthreshold ANCs and the low-energy $S$-factor, in particular, at the most effective energy of $300$ keV. Secondly, we calculate contributions to the $S(300\,{\rm keV})$-factor from the subthreshold $1^{-}$ and $2^{+}$ resonances, that are controlled by the subthreshold ANCs. We also evaluate the contribution of the uncertainties of the subthreshold ANCs to the budget of the low-energy $S$-factor uncertainty, especially, the $S(300\,{\rm keV})$-factor. Thirdly, we analyse interference of the subthreshold resonances (SRs) with higher resonances and with the $E1$ and $E2$ direct captures to the ground state. Finally, we investigate a correlated effect of the subthreshold and ground-state ANCs on the low-energy $S$-factor and, in particular, on the $S(300\,{\rm keV})$-factor.


title: PsyCoT: Psychological Questionnaire as Powerful Chain-of-Thought for Personality Detection

abstract: Recent advances in large language models (LLMs), such as ChatGPT, have showcased remarkable zero-shot performance across various NLP tasks. However, the potential of LLMs in personality detection, which involves identifying an individual's personality from their written texts, remains largely unexplored. Drawing inspiration from Psychological Questionnaires, which are carefully designed by psychologists to evaluate individual personality traits through a series of targeted items, we argue that these items can be regarded as a collection of well-structured chain-of-thought (CoT) processes. By incorporating these processes, LLMs can enhance their capabilities to make more reasonable inferences on personality from textual input. In light of this, we propose a novel personality detection method, called PsyCoT, which mimics the way individuals complete psychological questionnaires in a multi-turn dialogue manner. In particular, we employ a LLM as an AI assistant with a specialization in text analysis. We prompt the assistant to rate individual items at each turn and leverage the historical rating results to derive a conclusive personality preference. Our experiments demonstrate that PsyCoT significantly improves the performance and robustness of GPT-3.5 in personality detection, achieving an average F1 score improvement of 4.23/10.63 points on two benchmark datasets compared to the standard prompting method. Our code is available at https://github.com/TaoYang225/PsyCoT.


title: Diophantine conditions in the law of the iterated logarithm for lacunary systems

abstract: It is a classical observation that lacunary function systems exhibit many properties which are typical for systems of independent random variables. However, it had already been observed by Erd\H{o}s and Fortet in the 1950s that probability theory's limit theorems may fail for lacunary sums $\sum f(n_k x)$ if the sequence $(n_k)_{k \geq 1}$ has a strong arithmetic ''structure''. The presence of such structure can be assessed in terms of the number of solutions $k,\ell$ of two-term linear Diophantine equations $a n_k - b n_\ell = c$. As the first author proved with Berkes in 2010, saving an (arbitrarily small) unbounded factor for the number of solutions of such equations compared to the trivial upper bound, rules out pathological situations as in the Erd\H{o}s--Fortet example, and guarantees that $\sum f(n_k x)$ satisfies the central limit theorem (CLT) in a form which is in accordance with true independence. In contrast, as shown by the first author, for the law of the iterated logarithm (LIL) the Diophantine condition which suffices to ensure ''truly independent'' behavior requires saving this factor of logarithmic order. In the present paper we show that, rather surprisingly, saving such a logarithmic factor is actually the optimal condition in the LIL case. This result reveals the remarkable fact that the arithmetic condition required of $(n_k)_{k \geq 1}$ to ensure that $\sum f(n_k x)$ shows ''truly random'' behavior is a different one at the level of the CLT than it is at the level of the LIL: the LIL requires a stronger arithmetic condition than the CLT does.


title: Advancing Bayesian Optimization via Learning Correlated Latent Space

abstract: Bayesian optimization is a powerful method for optimizing black-box functions with limited function evaluations. Recent works have shown that optimization in a latent space through deep generative models such as variational autoencoders leads to effective and efficient Bayesian optimization for structured or discrete data. However, as the optimization does not take place in the input space, it leads to an inherent gap that results in potentially suboptimal solutions. To alleviate the discrepancy, we propose Correlated latent space Bayesian Optimization (CoBO), which focuses on learning correlated latent spaces characterized by a strong correlation between the distances in the latent space and the distances within the objective function. Specifically, our method introduces Lipschitz regularization, loss weighting, and trust region recoordination to minimize the inherent gap around the promising areas. We demonstrate the effectiveness of our approach on several optimization tasks in discrete data, such as molecule design and arithmetic expression fitting, and achieve high performance within a small budget.


title: Persistence of sub-chain groups

abstract: In this work, we present a generalization of extended persistent homology to filtrations of graded sub-groups by defining relative homology in this setting. Our work provides a more comprehensive and flexible approach to get an algebraic invariant overcoming the limitations of the standard approach. The main contribution of our work is the development of a stability theorem for extended persistence modules using an extension of the definition of interleaving and the rectangle measure. This stability theorem is a crucial property for the application of mathematical tools in data analysis. We apply the stability theorem to extended persistence modules obtained from extended path homology of directed graphs and extended homology of hypergraphs, which are two important examples in topological data analysis.


title: Learning to Play Chess from Textbooks (LEAP): a Corpus for Evaluating Chess Moves based on Sentiment Analysis

abstract: Learning chess strategies has been investigated widely, with most studies focussing on learning from previous games using search algorithms. Chess textbooks encapsulate grandmaster knowledge, explain playing strategies and require a smaller search space compared to traditional chess agents. This paper examines chess textbooks as a new knowledge source for enabling machines to learn how to play chess -- a resource that has not been explored previously. We developed the LEAP corpus, a first and new heterogeneous dataset with structured (chess move notations and board states) and unstructured data (textual descriptions) collected from a chess textbook containing 1164 sentences discussing strategic moves from 91 games. We firstly labelled the sentences based on their relevance, i.e., whether they are discussing a move. Each relevant sentence was then labelled according to its sentiment towards the described move. We performed empirical experiments that assess the performance of various transformer-based baseline models for sentiment analysis. Our results demonstrate the feasibility of employing transformer-based sentiment analysis models for evaluating chess moves, with the best performing model obtaining a weighted micro F_1 score of 68%. Finally, we synthesised the LEAP corpus to create a larger dataset, which can be used as a solution to the limited textual resource in the chess domain.


title: Theory of melting lines

abstract: Our understanding of the three basic states of matter (solids, liquids and gases) is based on temperature and pressure phase diagrams with three phase transition lines: solid-gas, liquid-gas and solid-liquid lines. There are analytical expressions $P(T)$ for the first two lines derived on a purely general-theoretical thermodynamic basis. In contrast, there exists no similar function for the third, melting, line (ML). Here, we develop a general two-phase theory of MLs and their analytical form. This theory predicts the parabolic form of the MLs for normal melting, relates the MLs to thermal and elastic properties of liquid and solid phases and quantitatively agrees with experimental MLs in different system types. We show that the parameters of the ML parabola are governed by fundamental physical constants. In this sense, parabolic MLs possess universality across different systems.


title: On the Karlsson-Nussbaum conjecture for resolvents of nonexpansive mappings

abstract: Let $D\subset \mathbb{R}^{n}$ be a bounded convex domain and $F:D\rightarrow D$ a $1$-Lipschitz mapping with respect to the Hilbert metric $d$ on $D$ satisfying condition $d(sx+(1-s)y,sz+(1-s)w)\leq \max \{d(x,z),d(y,w) \}$. We show that if $F$ does not have fixed points, then the convex hull of the accumulation points (in the norm topology) of the family $\{R_{\lambda }\}_{\lambda >0}$ of resolvents of $F$ is a subset of $\partial D.$ As a consequence, we show a Wolff-Denjoy type theorem for resolvents of nonexpansive mappings acting on an ellipsoid $D$.


title: On the Whitney disks in Heegaard Floer homology theory

abstract: The Whitney disks play a central role in defining Heegaard Floer homology of a $3$-dimensional manifold. We use Nielsen theory to a simple criterion to the existence of Whitney disks, connecting two given intersections.


title: Emergence of unitary symmetry of microcanonically truncated operators in chaotic quantum systems

abstract: We study statistical properties of matrix elements of observables written in the energy eigenbasis and truncated to small microcanonical windows. We present numerical evidence indicating that for all few body operators in chaotic many-body systems, truncated below certain energy scale, collective statistical properties of matrix elements exhibit emergent unitary symmetry. Namely, we show that below certain scale the spectra of the truncated operators exhibit universal behavior, matching our analytic predictions, which are numerically testable for system sizes beyond exact diagonalization. We discuss operator and system-size dependence of the energy scale of emergent unitary symmetry and put our findings in context of previous works exploring emergence of random-matrix behavior at small energy scales.


title: Low-Dose CT Image Enhancement Using Deep Learning

abstract: The application of ionizing radiation for diagnostic imaging is common around the globe. However, the process of imaging, itself, remains to be a relatively hazardous operation. Therefore, it is preferable to use as low a dose of ionizing radiation as possible, particularly in computed tomography (CT) imaging systems, where multiple x-ray operations are performed for the reconstruction of slices of body tissues. A popular method for radiation dose reduction in CT imaging is known as the quarter-dose technique, which reduces the x-ray dose but can cause a loss of image sharpness. Since CT image reconstruction from directional x-rays is a nonlinear process, it is analytically difficult to correct the effect of dose reduction on image quality. Recent and popular deep-learning approaches provide an intriguing possibility of image enhancement for low-dose artifacts. Some recent works propose combinations of multiple deep-learning and classical methods for this purpose, which over-complicate the process. However, it is observed here that the straight utilization of the well-known U-NET provides very successful results for the correction of low-dose artifacts. Blind tests with actual radiologists reveal that the U-NET enhanced quarter-dose CT images not only provide an immense visual improvement over the low-dose versions, but also become diagnostically preferable images, even when compared to their full-dose CT versions.


title: Beyond Average Return in Markov Decision Processes

abstract: What are the functionals of the reward that can be computed and optimized exactly in Markov Decision Processes?In the finite-horizon, undiscounted setting, Dynamic Programming (DP) can only handle these operations efficiently for certain classes of statistics. We summarize the characterization of these classes for policy evaluation, and give a new answer for the planning problem. Interestingly, we prove that only generalized means can be optimized exactly, even in the more general framework of Distributional Reinforcement Learning (DistRL).DistRL permits, however, to evaluate other functionals approximately. We provide error bounds on the resulting estimators, and discuss the potential of this approach as well as its limitations.These results contribute to advancing the theory of Markov Decision Processes by examining overall characteristics of the return, and particularly risk-conscious strategies.


title: A non-overlapping optimization-based domain decomposition approach to component-based model reduction of incompressible flows

abstract: We present a component-based model order reduction procedure to efficiently and accurately solve parameterized incompressible flows governed by the Navier-Stokes equations. Our approach leverages a non-overlapping optimization-based domain decomposition technique to determine the control variable that minimizes jumps across the interfaces between sub-domains. To solve the resulting constrained optimization problem, we propose both Gauss-Newton and sequential quadratic programming methods, which effectively transform the constrained problem into an unconstrained formulation. Furthermore, we integrate model order reduction techniques into the optimization framework, to speed up computations. In particular, we incorporate localized training and adaptive enrichment to reduce the burden associated with the training of the local reduced-order models. Numerical results are presented to demonstrate the validity and effectiveness of the overall methodology.


title: Constructing Sample-to-Class Graph for Few-Shot Class-Incremental Learning

abstract: Few-shot class-incremental learning (FSCIL) aims to build machine learning model that can continually learn new concepts from a few data samples, without forgetting knowledge of old classes. The challenges of FSCIL lies in the limited data of new classes, which not only lead to significant overfitting issues but also exacerbates the notorious catastrophic forgetting problems. As proved in early studies, building sample relationships is beneficial for learning from few-shot samples. In this paper, we promote the idea to the incremental scenario, and propose a Sample-to-Class (S2C) graph learning method for FSCIL. Specifically, we propose a Sample-level Graph Network (SGN) that focuses on analyzing sample relationships within a single session. This network helps aggregate similar samples, ultimately leading to the extraction of more refined class-level features. Then, we present a Class-level Graph Network (CGN) that establishes connections across class-level features of both new and old classes. This network plays a crucial role in linking the knowledge between different sessions and helps improve overall learning in the FSCIL scenario. Moreover, we design a multi-stage strategy for training S2C model, which mitigates the training challenges posed by limited data in the incremental process. The multi-stage training strategy is designed to build S2C graph from base to few-shot stages, and improve the capacity via an extra pseudo-incremental stage. Experiments on three popular benchmark datasets show that our method clearly outperforms the baselines and sets new state-of-the-art results in FSCIL.


title: Existence and uniqueness of the solutions to convection-diffusion equations

abstract: In this work, we study convection-diffusion equations in the cases of bounded drifts and drifts induced by the gradient of a potential. We define a new notion of solution and prove its existence and uniqueness. Furthermore, we show the conservation of mass, the convergence to the initial data, and the strong maximum principle.


title: Revisiting the theoretical basis of agent-based models for pedestrian dynamics

abstract: Robust agent-based models for pedestrian dynamics, which can predict the motion of pedestrians in various situations without specific adjustment of the model or its parameters, are highly desirable. But the modeller's task is challenging, in part because it mingles different types of processes (cognitive and mechanical ones) and different levels of description (global path planning and local navigation). We argue that the articulations between these processes or levels are not given sufficient attention in many current modelling frameworks and that this deficiency hampers the effectiveness of these models. Conversely, if a decision-making layer and a mechanical one are adequately distinguished, the former controlling the desired velocity that enters the latter, and if local navigation is not guided solely by intermediate way-points towards the target, but by broader spatial information (e.g., a floor field), then greater robustness can be achieved. This is illustrated with the ANDA model, recently proposed based on such considerations, which was found to reproduce a remarkably wide range of crowd scenarios with a single set of intrinsic parameters.


title: From Denoising Training to Test-Time Adaptation: Enhancing Domain Generalization for Medical Image Segmentation

abstract: In medical image segmentation, domain generalization poses a significant challenge due to domain shifts caused by variations in data acquisition devices and other factors. These shifts are particularly pronounced in the most common scenario, which involves only single-source domain data due to privacy concerns. To address this, we draw inspiration from the self-supervised learning paradigm that effectively discourages overfitting to the source domain. We propose the Denoising Y-Net (DeY-Net), a novel approach incorporating an auxiliary denoising decoder into the basic U-Net architecture. The auxiliary decoder aims to perform denoising training, augmenting the domain-invariant representation that facilitates domain generalization. Furthermore, this paradigm provides the potential to utilize unlabeled data. Building upon denoising training, we propose Denoising Test Time Adaptation (DeTTA) that further: (i) adapts the model to the target domain in a sample-wise manner, and (ii) adapts to the noise-corrupted input. Extensive experiments conducted on widely-adopted liver segmentation benchmarks demonstrate significant domain generalization improvements over our baseline and state-of-the-art results compared to other methods. Code is available at https://github.com/WenRuxue/DeTTA.


title: Beyond Best-Fits and Model Selection -- Introducing "Reliability" of cusp-core inference of dark matter halos

abstract: We introduce the notion of a Bayesian analysis motivated `reliability' that gives a truer distinction of cusp-core and other halo-parameters (like mass-concentration) in an ensemble of observed galaxies. Our approach goes beyond the standard statistical techniques of parameter estimation and model fitting. We create hundreds of thousands of realistic mock SPARC RCs, with both cuspy and cored DM density profiles as model inputs. These RCs carefully incorporate the details of SPARC data such as the nature of observed uncertainties and different sources of scatters arising from observation, presence of baryons, DM mass-concentration, etc. Bayesian analysis of these mock RCs enables us to reconstruct and identify the parameter space in galaxy observable and theory where one can venture beyond best-fits to a preferred DM halo model or model selections between different density models. We find that it is imperative to choose low stellar surface density ($\Sigma_{\star}$) galaxies for reliable cusp-vs-core distinction; for example, RC data for galaxies with $\Sigma_{\star} \leq 2.5$ is needed for a 75\% confidence in distinguishing cusps from cores. Similarly, we also find that for correct estimations of the halo masses and concentrations, the RCs need to be measured to at least a radial distance $\geq 0.8r_s$ where $r_s$ is the scale radii of the corresponding DM halo density profiles. Out of the total $\sim$ 135 SPARC galaxies, using our reliability criteria, we find that only 21 RCs clear the bar to be used for any unbiased cusp-core distinction as well as DM halo mass-concentration estimates at $\geq$75\% reliability confidence level. With $\geq$66\% ( $\geq$50\%) reliability settings, the sample size increases to 44 (59). Interestingly, in the $\geq 75$\% reliable subsample, there are 5 times more galaxies that are reliably cored than cuspy. [Abridged]


title: Geometric phase and wave-particle duality of the photon

abstract: The concepts of geometric phase and wave-particle duality are interlinked to several fundamental phenomena in quantum physics, but their mutual relationship still forms an uncharted open problem. Here we address this question by studying the geometric phase of a photon in double-slit interference. We especially discover a general complementarity relation for the photon that connects the geometric phase it exhibits in the observation plane and the which-path information it encases at the two slits. The relation can be seen as quantifying wave-particle duality of the photon via the geometric phase, thus corroborating a foundational link between two ubiquitous notions in quantum physics research.


title: Extracting Entities of Interest from Comparative Product Reviews

abstract: This paper presents a deep learning based approach to extract product comparison information out of user reviews on various e-commerce websites. Any comparative product review has three major entities of information: the names of the products being compared, the user opinion (predicate) and the feature or aspect under comparison. All these informing entities are dependent on each other and bound by the rules of the language, in the review. We observe that their inter-dependencies can be captured well using LSTMs. We evaluate our system on existing manually labeled datasets and observe out-performance over the existing Semantic Role Labeling (SRL) framework popular for this task.


title: Age Optimum Sampling in Non-Stationary Environment

abstract: In this work, we consider a status update system with a sensor and a receiver. The status update information is sampled by the sensor and then forwarded to the receiver through a channel with non-stationary delay distribution. The data freshness at the receiver is quantified by the Age-of-Information (AoI). The goal is to design an online sampling strategy that can minimize the average AoI when the non-stationary delay distribution is unknown. Assuming that channel delay distribution may change over time, to minimize the average AoI, we propose a joint stochastic approximation and non-parametric change point detection algorithm that can: (1) learn the optimum update threshold when the delay distribution remains static; (2) detect the change in transmission delay distribution quickly and then restart the learning process. Simulation results show that the proposed algorithm can quickly detect the delay changes, and the average AoI obtained by the proposed policy converges to the minimum AoI.


title: Temperature dependent optical properties of $\varepsilon$-Ga$_2$O$_3$ thin films

abstract: We determined the complex dielectric functions of $\varepsilon$-Ga$_2$O$_3$ using optical transmittance and reflectance spectroscopies at temperatures from 10 K to room temperature. The measured dielectric-function spectra reveal distinct structures at a bandgap energy. We fitted a model dielectric function based on the electronic energy-band structure to these experimental data. We analyzed the temperature dependence of the band-gap with a model based on phonon dispersion effects. One could explain it in terms of phonon-related parameters such as the optical phonon temperature. We compare phonon-related properties of $\varepsilon$-Ga$_2$O$_3$ with those of a large variety of element and binary semiconductors.


title: Towards a Structural Equation Model of Open Source Blockchain Software Health

abstract: The widespread use of GitHub among software developers as a communal platform for coordinating software development has led to an abundant supply of publicly accessible data. Ever since the inception of Bitcoin, blockchain teams have incorporated the concept of open source code as a fundamental principle, thus making the majority of blockchain-based projects' code and version control data available for analysis. We define health in open source software projects to be a combination of the concepts of sustainability, robustness, and niche occupation. Sustainability is further divided into interest and engagement. This work uses exploratory factor analysis to identify latent constructs that are representative of general public interest or popularity in software, and software robustness within open source blockchain projects. We find that interest is a combination of stars, forks, and text mentions in the GitHub repository, while a second factor for robustness is composed of a criticality score, time since last updated, numerical rank, and geographic distribution. Cross validation of the dataset is carried out with good support for the model. A structural model of software health is proposed such that general interest positively influences developer engagement, which, in turn, positively predicts software robustness. The implications of structural equation modelling in the context of software engineering and next steps are discussed.


title: How do baryonic effects on the cosmic matter distribution vary with scale and local density environment?

abstract: In this study, we investigate how the baryonic effects vary with scale and local density environment mainly by utilizing a novel statistic, the environment-dependent wavelet power spectrum (env-WPS). With four state-of-the-art cosmological simulation suites, EAGLE, SIMBA, Illustris, and IllustrisTNG, we compare the env-WPS of the total matter density field between the hydrodynamic and dark matter-only (DMO) runs at $z=0$. We find that the clustering is most strongly suppressed in the emptiest environment of $\rho_\mathrm{m}/\bar\rho_\mathrm{m}<0.1$ with maximum amplitudes $\sim67-89$ per cent on scales $\sim1.86-10.96\ h\mathrm{Mpc}^{-1}$, and less suppressed in higher density environments on small scales (except Illustris). In the environments of $\rho_\mathrm{m}/\bar\rho_\mathrm{m}\geqslant0.316$ ($\geqslant10$ in EAGLE), the feedbacks also lead to enhancement features at intermediate and large scales, which is most pronounced in the densest environment of $\rho_\mathrm{m}/\bar\rho_\mathrm{m}\geqslant100$ and reaches a maximum $\sim 7-15$ per cent on scales $\sim0.87-2.62\ h\mathrm{Mpc}^{-1}$ (except Illustris). The baryon fraction of the local environment decreases with increasing density, denoting the feedback strength, and potentially explaining some differences between simulations. We also measure the volume and mass fractions of local environments, which are affected by $\gtrsim 1$ per cent due to baryon physics. In conclusion, our results show that the baryonic processes can strongly modify the overall cosmic structure on the scales of $k>0.1\ h\mathrm{Mpc}^{-1}$, which encourages further research in this direction.


title: Machine learning refinement of in situ images acquired by low electron dose LC-TEM

abstract: We study a machine learning (ML) technique for refining images acquired during in situ observation using liquid-cell transmission electron microscopy (LC-TEM). Our model is constructed using a U-Net architecture and a ResNet encoder. For training our ML model, we prepared an original image dataset that contained pairs of images of samples acquired with and without a solution present. The former images were used as noisy images and the latter images were used as corresponding ground truth images. The number of pairs of image sets was $1,204$ and the image sets included images acquired at several different magnifications and electron doses. The trained model converted a noisy image into a clear image. The time necessary for the conversion was on the order of 10ms, and we applied the model to in situ observations using the software Gatan DigitalMicrograph (DM). Even if a nanoparticle was not visible in a view window in the DM software because of the low electron dose, it was visible in a successive refined image generated by our ML model.


title: AutoMixer for Improved Multivariate Time-Series Forecasting on Business and IT Observability Data

abstract: The efficiency of business processes relies on business key performance indicators (Biz-KPIs), that can be negatively impacted by IT failures. Business and IT Observability (BizITObs) data fuses both Biz-KPIs and IT event channels together as multivariate time series data. Forecasting Biz-KPIs in advance can enhance efficiency and revenue through proactive corrective measures. However, BizITObs data generally exhibit both useful and noisy inter-channel interactions between Biz-KPIs and IT events that need to be effectively decoupled. This leads to suboptimal forecasting performance when existing multivariate forecasting models are employed. To address this, we introduce AutoMixer, a time-series Foundation Model (FM) approach, grounded on the novel technique of channel-compressed pretrain and finetune workflows. AutoMixer leverages an AutoEncoder for channel-compressed pretraining and integrates it with the advanced TSMixer model for multivariate time series forecasting. This fusion greatly enhances the potency of TSMixer for accurate forecasts and also generalizes well across several downstream tasks. Through detailed experiments and dashboard analytics, we show AutoMixer's capability to consistently improve the Biz-KPI's forecasting accuracy (by 11-15\%) which directly translates to actionable business insights.


title: On the 1d stochastic Schr\"odinger product

abstract: We exhibit various restrictions about the wellposedness of the Schr\"odinger product $$\mathcal{L}: z \longmapsto -\imath \int_0^t e^{\imath \Delta s}\big( z_s\cdot \Psi_s\big) ds $$ where $\Psi$ refers to the so-called linear solution of the stochastic Schr\"dinger problem. We focus more specifically on the case where $\Psi$ satisfies $$(\imath \partial_t-\Delta)\Psi=\dot{B}, \quad \Psi_0=0,\quad \quad t\in \mathbb{R}, \ x\in \mathbb{T},$$where $\dot{B}$ is a white noise in space with fractional time covariance of index $H>\frac12$. As an important consequence of our analysis, we obtain that if $H$ is close to $\frac12$ (that is $\dot{B}$ is close to a space-time white noise), then it is essentially impossible to treat the stochastic NLS problem $$(\imath \partial_t-\Delta)u=\lambda\, u^{p} \overline{u}^q+\dot{B}, \quad u_0=0,\quad \quad \lambda \in \{-1,1\}, \ p,q\geq 1, \ t\in \mathbb{R}, \ x\in \mathbb{T},$$using only a first-order expansion of the solution ("$u=\Psi+z$").


title: Large extra dimensions from higher-dimensional inflation

abstract: We propose the possibility that compact extra dimensions can obtain large size by higher dimensional inflation, relating the weakness of the actual gravitational force to the size of the observable universe. Solution to the horizon problem implies that the fundamental scale of gravity is smaller than $10^{13}$ GeV which can be realised in a braneworld framework for any number of extra dimensions. However, requirement of (approximate) flat power spectrum of primordial density fluctuations consistent with present observations makes this simple proposal possible only for one extra dimension at around the micron scale. After the end of five-dimensional inflation, the radion modulus can be stabilised at a vacuum with positive energy of the order of the present dark energy scale. An attractive possibility is based on the contribution to the Casimir energy of right-handed neutrinos with a mass at a similar scale.


title: Estimates of stability with respect to the number of summands for distributions of successive sums of independent identically distributed vectors

abstract: Let $X_1,\dots, X_n,\dots$ be i.i.d.\ $d$-dimensional random vectors with common distribution $F$. Then $S_n = X_1+\dots+X_n$ has distribution $F^n$ (degree is understood in the sense of convolution). Let $$ \rho_{\mathcal{C}_d}(F,G) = \sup_A |F\{A\} - G\{A\}|, $$ where the supremum is taken over all convex subsets of $\mathbb R^d$. Basic result is as follows. For any nontrivial distribution $F$ there is $c_1(F)$ such that $$ \rho_{\mathcal{C}_d}(F^n, F^{n+1})\leq \frac{c_1(F)}{\sqrt n} $$ for any natural $n$. The distribution $F$ is called trivial if it is concentrated on a hyperplane that does not contain the origin. Clearly, for such $F$ $$ \rho_{\mathcal{C}_d}(F^n, F^{n+1}) = 1. $$ A similar result for the Prokhorov distance is also obtained. For any $d$-dimensional distribution~$F$ there is a $c_2(F)>0$ that depends only on $F$ and such that \begin{multline}\nonumber (F^n)\{A\}\le (F^{n+1})\{A^{c_2(F)}\}+\frac{c_2(F)}{\sqrt{n}} \text{and}\quad (F^{n+1})\{A\}\leq (F^n)\{A^{c_2(F)}\}+\frac{c_2(F)} {\sqrt{n}} \end{multline} for any Borel set $ A $ for all positive integers $n$. Here $A^{\varepsilon }$ is $ \varepsilon $-neighborhood of the set $ A $.


title: Abnormal Singular Foliations and the Sard Conjecture for generic co-rank one distributions

abstract: Given a smooth totally nonholonomic distribution on a smooth manifold, we construct a singular distribution capturing essential abnormal lifts which is locally generated by vector fields with controlled divergence. Then, as an application, we prove the Sard Conjecture for rank 3 distribution in dimension 4 and generic distributions of corank 1.


title: Accelerating Generalized Linear Models by Trading off Computation for Uncertainty

abstract: Bayesian Generalized Linear Models (GLMs) define a flexible probabilistic framework to model categorical, ordinal and continuous data, and are widely used in practice. However, exact inference in GLMs is prohibitively expensive for large datasets, thus requiring approximations in practice. The resulting approximation error adversely impacts the reliability of the model and is not accounted for in the uncertainty of the prediction. In this work, we introduce a family of iterative methods that explicitly model this error. They are uniquely suited to parallel modern computing hardware, efficiently recycle computations, and compress information to reduce both the time and memory requirements for GLMs. As we demonstrate on a realistically large classification problem, our method significantly accelerates training compared to competitive baselines by trading off reduced computation for increased uncertainty.


title: Measurement of Angular Coefficients of $\bar{B} \to D^* \ell \bar{\nu}_\ell$: Implications for $|V_{cb}|$ and Tests of Lepton Flavor Universality

abstract: We measure the complete set of angular coefficients $J_i$ for exclusive $\bar{B} \to D^* \ell \bar{\nu}_\ell$ decays ($\ell = e, \mu$). Our analysis uses the full $711\,\mathrm{fb}^{-1}$ Belle data set with hadronic tag-side reconstruction. The results allow us to extract the form factors describing the $B \to D^*$ transition and the Cabibbo-Kobayashi-Maskawa matrix element $|V_{\rm cb}|$. Using recent lattice QCD calculations for the hadronic form factors, we find $|V_{\rm cb}| = (41.0 \pm 0.7) \times 10^3 $ using the BGL parameterization, compatible with determinations from inclusive semileptonic decays. We search for lepton flavor universality violation as a function of the hadronic recoil parameter $w$, and investigate the differences of the electron and muon angular distributions. We find no deviation from Standard Model expectations.


title: Sample-Efficient and Safe Deep Reinforcement Learning via Reset Deep Ensemble Agents

abstract: Deep reinforcement learning (RL) has achieved remarkable success in solving complex tasks through its integration with deep neural networks (DNNs) as function approximators. However, the reliance on DNNs has introduced a new challenge called primacy bias, whereby these function approximators tend to prioritize early experiences, leading to overfitting. To mitigate this primacy bias, a reset method has been proposed, which performs periodic resets of a portion or the entirety of a deep RL agent while preserving the replay buffer. However, the use of the reset method can result in performance collapses after executing the reset, which can be detrimental from the perspective of safe RL and regret minimization. In this paper, we propose a new reset-based method that leverages deep ensemble learning to address the limitations of the vanilla reset method and enhance sample efficiency. The proposed method is evaluated through various experiments including those in the domain of safe RL. Numerical results show its effectiveness in high sample efficiency and safety considerations.


title: The Cohen--Lyndon property in non-metric small-cancellation

abstract: We show that the Cohen--Lyndon property holds for classical $C(6)$ small-cancellation quotients, thus generalising the analogous result from the $C'(\frac{1}{6})$ setting, and answering a 1966 question of Lyndon.


title: C-Silicon-based metasurfaces for aperture-robust spectrometer/imaging with angle integration

abstract: Compared with conventional grating-based spectrometers, reconstructive spectrometers based on spectrally engineered filtering have the advantage of miniaturization because of the less demand for dispersive optics and free propagation space. However, available reconstructive spectrometers fail to balance the performance on operational bandwidth, spectral diversity and angular stability. In this work, we proposed a compact silicon metasurfaces based spectrometer/camera. After angle integration, the spectral response of the system is robust to angle/aperture within a wide working bandwidth from 400nm to 800nm. It is experimentally demonstrated that the proposed method could maintain the spectral consistency from F/1.8 to F/4 (The corresponding angle of incident light ranges from 7{\deg} to 16{\deg}) and the incident hyperspectral signal could be accurately reconstructed with a fidelity exceeding 99%. Additionally, a spectral imaging system with 400x400 pixels is also established in this work. The accurate reconstructed hyperspectral image indicates that the proposed aperture-robust spectrometer has the potential to be extended as a high-resolution broadband hyperspectral camera.


title: On Rayleigh Quotient Iteration for Dual Quaternion Hermitian Eigenvalue Problem

abstract: The application of eigenvalue theory to dual quaternion Hermitian matrices holds significance in the realm of multi-agent formation control. In this paper, we study the Rayleigh quotient iteration (RQI) for solving the right eigenpairs of dual quaternion Hermitian matrices. Combined with dual representation, the RQI algorithm can effectively compute the extreme eigenvalue along with the associated eigenvector of the large dual quaternion Hermitian matrices. Furthermore, a convergence analysis of the Rayleigh quotient iteration is derived, demonstrating a local convergence rate of at least cubic, which is faster than the linear convergence rate of the power method. Numerical examples are provided to illustrate the high accuracy and low CPU time cost of the proposed Rayleigh quotient iteration compared with the power method for solving the dual quaternion Hermitian eigenvalue problem.


title: Translation algorithms for graph covers

abstract: Graph covers are a way to describe continuous maps (and homeomorphisms) of the Cantor set, more generally than e.g.\ Bratteli-Vershik systems. Every continuous map on a zero-dimensional compact set can be expressed by a graph cover (e.g.\ non-minimality or aperiodicty are no restrictions). We give a survey on the construction, properties and some special cases of graph covers.


title: IARS SegNet: Interpretable Attention Residual Skip connection SegNet for melanoma segmentation

abstract: Skin lesion segmentation plays a crucial role in the computer-aided diagnosis of melanoma. Deep Learning models have shown promise in accurately segmenting skin lesions, but their widespread adoption in real-life clinical settings is hindered by their inherent black-box nature. In domains as critical as healthcare, interpretability is not merely a feature but a fundamental requirement for model adoption. This paper proposes IARS SegNet an advanced segmentation framework built upon the SegNet baseline model. Our approach incorporates three critical components: Skip connections, residual convolutions, and a global attention mechanism onto the baseline Segnet architecture. These elements play a pivotal role in accentuating the significance of clinically relevant regions, particularly the contours of skin lesions. The inclusion of skip connections enhances the model's capacity to learn intricate contour details, while the use of residual convolutions allows for the construction of a deeper model while preserving essential image features. The global attention mechanism further contributes by extracting refined feature maps from each convolutional and deconvolutional block, thereby elevating the model's interpretability. This enhancement highlights critical regions, fosters better understanding, and leads to more accurate skin lesion segmentation for melanoma diagnosis.


title: Annotator: A Generic Active Learning Baseline for LiDAR Semantic Segmentation

abstract: Active learning, a label-efficient paradigm, empowers models to interactively query an oracle for labeling new data. In the realm of LiDAR semantic segmentation, the challenges stem from the sheer volume of point clouds, rendering annotation labor-intensive and cost-prohibitive. This paper presents Annotator, a general and efficient active learning baseline, in which a voxel-centric online selection strategy is tailored to efficiently probe and annotate the salient and exemplar voxel girds within each LiDAR scan, even under distribution shift. Concretely, we first execute an in-depth analysis of several common selection strategies such as Random, Entropy, Margin, and then develop voxel confusion degree (VCD) to exploit the local topology relations and structures of point clouds. Annotator excels in diverse settings, with a particular focus on active learning (AL), active source-free domain adaptation (ASFDA), and active domain adaptation (ADA). It consistently delivers exceptional performance across LiDAR semantic segmentation benchmarks, spanning both simulation-to-real and real-to-real scenarios. Surprisingly, Annotator exhibits remarkable efficiency, requiring significantly fewer annotations, e.g., just labeling five voxels per scan in the SynLiDAR-to-SemanticKITTI task. This results in impressive performance, achieving 87.8% fully-supervised performance under AL, 88.5% under ASFDA, and 94.4% under ADA. We envision that Annotator will offer a simple, general, and efficient solution for label-efficient 3D applications. Project page: https://binhuixie.github.io/annotator-web


title: Robust nonparametric regression based on deep ReLU neural networks

abstract: In this paper, we consider robust nonparametric regression using deep neural networks with ReLU activation function. While several existing theoretically justified methods are geared towards robustness against identical heavy-tailed noise distributions, the rise of adversarial attacks has emphasized the importance of safeguarding estimation procedures against systematic contamination. We approach this statistical issue by shifting our focus towards estimating conditional distributions. To address it robustly, we introduce a novel estimation procedure based on $\ell$-estimation. Under a mild model assumption, we establish general non-asymptotic risk bounds for the resulting estimators, showcasing their robustness against contamination, outliers, and model misspecification. We then delve into the application of our approach using deep ReLU neural networks. When the model is well-specified and the regression function belongs to an $\alpha$-H\"older class, employing $\ell$-type estimation on suitable networks enables the resulting estimators to achieve the minimax optimal rate of convergence. Additionally, we demonstrate that deep $\ell$-type estimators can circumvent the curse of dimensionality by assuming the regression function closely resembles the composition of several H\"older functions. To attain this, new deep fully-connected ReLU neural networks have been designed to approximate this composition class. This approximation result can be of independent interest.


title: First observation and study of the $K^{\pm} \rightarrow \pi^{0} \pi^{0} \mu^{\pm} \nu$ decay

abstract: The NA48/2 experiment at CERN reports the first observation of the $K^{\pm} \rightarrow \pi^{0} \pi^{0} \mu^{\pm} \nu$ decay based on a sample of 2437 candidates with 15% background contamination collected in 2003--2004. The decay branching ratio in the kinematic region of the squared dilepton mass above $0.03$~GeV$^2/c^4$ is measured to be $(0.65 \pm 0.03) \times 10^{-6}$. The extrapolation to the full kinematic space, using a specific model, is found to be $(3.45 \pm 0.16) \times 10^{-6}$, in agreement with chiral perturbation theory predictions.


title: Theoretical Analysis of Terahertz Detection of Resonant Tunneling Diodes

abstract: We analyze the terahertz detection characteristics of resonant tunneling diodes (RTDs) using a set of simple equations that covers three detection modes; (i) direct detection, (ii) amplified detection, and (iii) self-homodyne (coherent) detection. (i) and (ii) are based on the square-law detection, and (iii) is on the homodyne detection with the RTD used as an injection-locked local oscillator. The calculated results exhibit small- and large-signal areas depending on irradiation power. In the small-signal area, the detection current is proportional to irradiated power for (i) and (ii), and to square root of irradiated power for (iii). The detection current has a peak at the bias voltage at the boundary between (ii) and (iii). Effect of frequency fluctuation of irradiated wave is analyzed for (iii), and it is shown that the detection current is proportional to irradiated power if the fluctuation becomes wider than injection-locking range. The analytical results in this paper reasonably explain the reported experiments.


title: Surface Second Harmonic Generation in Centrosymmetric Molecular Crystalline Materials: How Thick is the Surface?

abstract: Second harmonic generation (SHG) is forbidden in centrosymmetric molecular materials. However, a signal is frequently observed from interfaces where the symmetry is broken. Whereas the effect can be phenomenologically accommodated, an ab initio qualitative and quantitative description has remained elusive, preventing the exploration of fascinating questions such as how deep below the surface the second harmonic can still be generated. To answer such questions, we present an ab initio multiscale approach to compute the total and layer-dependent intensity of surface SHG from molecular crystals. The microscopic origin of surface SHG is identified in layer-dependent models with embedding partial charges combined with density functional theory. The models show increasing symmetry-breaking distortions of the electron cloud around the molecules as the surface layer is approached. The SHG at the molecular level is determined using time-dependent density functional theory and then brought to the scale of macroscopic films through a rigorous self-consistent multiple scattering formalism capable of predicting the measurable optical intensities of the generated second harmonic signal. We study crystalline molecular films with centrosymmetric unit cells of 7,9-Dibromobenzo[h]quinolin-10-ol. The intensity of the SHG at the surface layer is two orders of magnitude larger than at the next layer below and three orders of magnitude larger than two layers below. Besides providing fundamental understanding, our approach can be used for designing and optimizing optical devices containing nonlinear molecular materials, such as molecular laminates. We show that a relatively basic Kretschmann-like setup can enhance the surface SHG of a crystalline film of centrosymmetric molecular unit cells a thousand times.


title: Analysis to closed surface-wave photonic crystal waveguides based on coupled-resonator optical waveguide theory

abstract: Traditionally, one can construct a waveguide by introduce defects into surface-wave photonic crystals (SPCs). Here we propose a new structure named closed SPC that can introduce waveguide modes out of photonic bandgap of surface-wave photonic crystal. In this paper, we have comprehensively analyzed dispersion relation, group velocity, normalized transmission and electric field distribution of closed SPC waveguides, and propose several methods to improve performance of the waveguide based on coupled-resonator optical waveguide theory. These methods can improve transmission efficiency from 10% to 60% and eliminate intraband oscillation by adjusting eigenfrequency and coupling factor . These methods are applicable to both single mode and multi mode situations. This letter also paves a new way for improving the performance of other coupled-resonator waveguides.


title: Verification of Neural Networks Local Differential Classification Privacy

abstract: Neural networks are susceptible to privacy attacks. To date, no verifier can reason about the privacy of individuals participating in the training set. We propose a new privacy property, called local differential classification privacy (LDCP), extending local robustness to a differential privacy setting suitable for black-box classifiers. Given a neighborhood of inputs, a classifier is LDCP if it classifies all inputs the same regardless of whether it is trained with the full dataset or whether any single entry is omitted. A naive algorithm is highly impractical because it involves training a very large number of networks and verifying local robustness of the given neighborhood separately for every network. We propose Sphynx, an algorithm that computes an abstraction of all networks, with a high probability, from a small set of networks, and verifies LDCP directly on the abstract network. The challenge is twofold: network parameters do not adhere to a known distribution probability, making it difficult to predict an abstraction, and predicting too large abstraction harms the verification. Our key idea is to transform the parameters into a distribution given by KDE, allowing to keep the over-approximation error small. To verify LDCP, we extend a MILP verifier to analyze an abstract network. Experimental results show that by training only 7% of the networks, Sphynx predicts an abstract network obtaining 93% verification accuracy and reducing the analysis time by $1.7\cdot10^4$x.


title: Pre-Lie algebras with divided powers and the Deligne groupoid in positive characteristic

abstract: The purpose of this paper is to develop a deformation theory controlled by pre-Lie algebras with divided powers over a ring of positive characteristic. We show that every differential graded pre-Lie algebra with divided powers comes with operations, called weighted braces, which we use to generalize the classical deformation theory controlled by Lie algebras over a field of characteristic $0$. Explicitly, we define the Maurer-Cartan set, as well as the gauge group, and prove that there is an action of the gauge group on the Maurer-Cartan set. This new deformation theory moreover admits a Goldman-Millson theorem which remains valid on the integers. As an application, we give the computation of the $\pi_0$ of a mapping space $\text{Map}(B^c(\mathcal{C}),\mathcal{P})$ with $\mathcal{C}$ and $\mathcal{P}$ suitable cooperad and operad respectively.


title: Revolutionizing Global Food Security: Empowering Resilience through Integrated AI Foundation Models and Data-Driven Solutions

abstract: Food security, a global concern, necessitates precise and diverse data-driven solutions to address its multifaceted challenges. This paper explores the integration of AI foundation models across various food security applications, leveraging distinct data types, to overcome the limitations of current deep and machine learning methods. Specifically, we investigate their utilization in crop type mapping, cropland mapping, field delineation and crop yield prediction. By capitalizing on multispectral imagery, meteorological data, soil properties, historical records, and high-resolution satellite imagery, AI foundation models offer a versatile approach. The study demonstrates that AI foundation models enhance food security initiatives by providing accurate predictions, improving resource allocation, and supporting informed decision-making. These models serve as a transformative force in addressing global food security limitations, marking a significant leap toward a sustainable and secure food future.


title: Exponential F(R) gravity with axion dark matter

abstract: The cosmological evolution within the framework of exponential $F(R)$ gravity is analysed by assuming two forms for dark matter: (a) a standard dust-like fluid and (b) an axion scalar field. As shown in previous literature, an axion-like field oscillates during the cosmological evolution but can play the role of dark matter when approaching the minimum of its potential. Both scenarios are confronted with recent observational data including the Pantheon Type Ia supernovae, Hubble parameter estimations (Cosmic Chronometers), Baryon Acoustic Oscillations and Cosmic Microwave Background distances. The models show great possibilities in describing these observations when compared with the $\Lambda$CDM model, supporting the viability of exponential $F(R)$ gravity. The differences between both descriptions of dark matter is analysed.


title: The theory of symmetric tensor field with boundary: Kac-Moody algebras in linearized gravity

abstract: In this paper we consider four dimensional (4D) linearized gravity (LG) with a planar boundary, where the most general boundary conditions are derived following Symanzik's approach. The boundary breaks diffeomorphism invariance and this results in a breaking of the corresponding Ward identity. From this, on the boundary we find two conserved currents which form an algebraic structure of the Kac-Moody type, with a central charge proportional to the action ``coupling''. Moreover, we identify the boundary degrees of freedom, which are two symmetric rank-2 tensor fields, and derive the symmetry transformations, which are diffeomorphisms. The corresponding most general 3D action is obtained and a contact with the higher dimensional theory is established by requiring that the 3D equations of motion coincide with the 4D boundary conditions. Through this kind of holographic procedure, we find two solutions~: LG for a single tensor field and LG for two tensor fields with a mixing term. Curiously, we find that the Symanzik's 4D boundary term which governs the whole procedure contains a mass term of the Fierz-Pauli type for the bulk graviton.


title: Advancing Fluid Dynamics Stability Analysis: Construction of Lyapunov Functions via the Generalized Kinetic Energy Approach

abstract: The energy method, also known as the Reynolds-Orr equation, is widely utilized in predicting the unconditional stability threshold of shear flows owing to the zero contribution of nonlinear terms to the time derivative of perturbation kinetic energy. However, it often underestimates the critical Reynolds numbers compared to experimental measurements. On the other hand, linear stability analysis tends to yield impractically high limits due to the occurrence of subcritical transitions. A novel methodology is introduced to enhance and validate the generalized kinetic energy formulation, aiming to provide a more accurate estimation of transition. This method considers the influence of nonlinear terms in calculating the threshold amplitude. The efficacy of this approach is showcased through the utilization of basic low-order turbulence models and the Poiseuille flow as illustrative examples. Through the proposed technique, the objective is to bridge the disparity between theoretically predicted critical Reynolds numbers and experimental observations, thus providing a more precise evaluation of shear flow stability. This research contributes to the advancement of stability analysis methods, offering practical implications for diverse fluid flow scenarios.


title: Bilateral Network with Residual U-blocks and Dual-Guided Attention for Real-time Semantic Segmentation

abstract: When some application scenarios need to use semantic segmentation technology, like automatic driving, the primary concern comes to real-time performance rather than extremely high segmentation accuracy. To achieve a good trade-off between speed and accuracy, two-branch architecture has been proposed in recent years. It treats spatial information and semantics information separately which allows the model to be composed of two networks both not heavy. However, the process of fusing features with two different scales becomes a performance bottleneck for many nowaday two-branch models. In this research, we design a new fusion mechanism for two-branch architecture which is guided by attention computation. To be precise, we use the Dual-Guided Attention (DGA) module we proposed to replace some multi-scale transformations with the calculation of attention which means we only use several attention layers of near linear complexity to achieve performance comparable to frequently-used multi-layer fusion. To ensure that our module can be effective, we use Residual U-blocks (RSU) to build one of the two branches in our networks which aims to obtain better multi-scale features. Extensive experiments on Cityscapes and CamVid dataset show the effectiveness of our method.


title: Emergence of diverse array of phases in an exactly solvable model

abstract: We propose an exactly solvable lattice model, motivated by the significance of the extended Hubbard model ($t-U-V$ model) and inspired by the work of Hatsugai and Kohmoto. The ground state exhibits a diverse array of phases, including the charge-$4e$ condensed phase, the charge-$2e$ superconducting phase, the half-filled insulating phase, the quarter-filled insulating phase, the metallic phase, and an unconventional metallic phase. Among them, the unconventional metallic phase could be of particular significance, for the coexistence of electrons and pairs at zero energy. These findings are poised to advance our understanding and exploration of strongly correlated physics.


title: Causal Interpretation of Self-Attention in Pre-Trained Transformers

abstract: We propose a causal interpretation of self-attention in the Transformer neural network architecture. We interpret self-attention as a mechanism that estimates a structural equation model for a given input sequence of symbols (tokens). The structural equation model can be interpreted, in turn, as a causal structure over the input symbols under the specific context of the input sequence. Importantly, this interpretation remains valid in the presence of latent confounders. Following this interpretation, we estimate conditional independence relations between input symbols by calculating partial correlations between their corresponding representations in the deepest attention layer. This enables learning the causal structure over an input sequence using existing constraint-based algorithms. In this sense, existing pre-trained Transformers can be utilized for zero-shot causal-discovery. We demonstrate this method by providing causal explanations for the outcomes of Transformers in two tasks: sentiment classification (NLP) and recommendation.


title: A physics-informed GAN Framework based on Model-free Data-Driven Computational Mechanics

abstract: Model-free data-driven computational mechanics, first proposed by Kirchdoerfer and Ortiz, replace phenomenological models with numerical simulations based on sample data sets in strain-stress space. In this study, we integrate this paradigm within physics-informed generative adversarial networks (GANs). We enhance the conventional physics-informed neural network framework by implementing the principles of data-driven computational mechanics into GANs. Specifically, the generator is informed by physical constraints, while the discriminator utilizes the closest strain-stress data to discern the authenticity of the generator's output. This combined approach presents a new formalism to harness data-driven mechanics and deep learning to simulate and predict mechanical behaviors.


title: Tensor formalism for predicting synaptic connections with ensemble modeling or optimization

abstract: Theoretical neuroscientists often try to understand how the structure of a neural network relates to its function by focusing on structural features that would either follow from optimization or occur consistently across possible implementations. Both optimization theories and ensemble modeling approaches have repeatedly proven their worth, and it would simplify theory building considerably if predictions from both theory types could be derived and tested simultaneously. Here we show how tensor formalism from theoretical physics can be used to unify and solve many optimization and ensemble modeling approaches to predicting synaptic connectivity from neuronal responses. We specifically focus on analyzing the solution space of synaptic weights that allow a threshold-linear neural network to respond in a prescribed way to a limited number of input conditions. For optimization purposes, we compute the synaptic weight vector that minimizes an arbitrary quadratic loss function. For ensemble modeling, we identify synaptic weight features that occur consistently across all solutions bounded by an arbitrary ellipsoid. We derive a common solution to this suite of nonlinear problems by showing how each of them reduces to an equivalent linear problem that can be solved analytically. Although identifying the equivalent linear problem is nontrivial, our tensor formalism provides an elegant geometrical perspective that allows us to solve the problem approximately in an analytical way or exactly using numeric methods. The final algorithm is applicable to a wide range of interesting neuroscience problems, and the associated geometric insights may carry over to other scientific problems that require constrained optimization.


title: Energy Conserving Higher Order Mixed Finite Element Discretizations of Maxwell's Equations

abstract: We study a system of Maxwell's equations that describes the time evolution of electromagnetic fields with an additional electric scalar variable to make the system amenable to a mixed finite element spatial discretization. We demonstrate stability and energy conservation for the variational formulation of this Maxwell's system. We then discuss two implicit, energy conserving schemes for its temporal discretization: the classical Crank-Nicholson scheme and an implicit leapfrog scheme. We next show discrete stability and discrete energy conservation for the semi-discretization using these two time integration methods. We complete our discussion by showing that the error for the full discretization of the Maxwell's system with each of the two implicit time discretization schemes and with spatial discretization through a conforming sequence of de Rham finite element spaces converges quadratically in the step size of the time discretization and as an appropriate polynomial power of the mesh parameter in accordance with the choice of approximating polynomial spaces. Our results for the Crank-Nicholson method are generally well known but have not been demonstrated for this Maxwell's system. Our implicit leapfrog scheme is a new method to the best of our knowledge and we provide a complete error analysis for it. Finally, we show computational results to validate our theoretical claims using linear and quadratic Whitney forms for the finite element discretization for some model problems in two and three spatial dimensions.


title: Steady water-waves with arbitrary surface-pressure: Their recovery from bottom-pressure measurements

abstract: Equations relating the pressure at a horizontal seabed, the free-surface profile and the surface-pressure are derived for two-dimensional irrotational steady water waves with arbitrary pressure at the free surface. Special cases include gravity, capillary, flexural and wind waves. Without approximations, we show that the free-surface recovery from the bottom-pressure requires the resolution of only one first-order ordinary differential equation independent of the surface-pressure, thus providing a new general recovery method valid for a broad class of water waves. Another equation provides an explicit expression for the surface-pressure as a function of the bottom-pressure and of the free-surface. Thus, if unknown, the surface-pressure can be also recovered if one extra measurement is available. This new recovery procedure is illustrated analytically for the linear approximation of a flexural-capillary-gravity wave, and numerically for fully nonlinear capillary-gravity waves.


title: Multi-state models for double transitions associated with parasitism in biological control

abstract: Competition between parasitoids can reduce the success of pest control in biological programs using two species as bio-control agents or when multiple species exploit the same host crop. Parasitoid foraging behavior and the ability to identify already parasitized hosts affect the efficacy of parasitoid species as bio-agents to regulate pest insects. We evaluated the behavioural changes of parasitoids according to the quality of hosts ({\it i.e.}, previously parasitised or not), and the characterisation of these transitions over time via multi-state models. We evaluated the effects of previous parasitism of the brown stinkbug {\it Euschistus heros} eggs on the parasitism rate of the species {\it Trissolcus basalis} and {\it Telenomus podisi}. We successively modelled the choice of eggs (with three possibilities: non parasitised eggs, eggs previously parasitised by {\it T. podisi}, and eggs previously parasitised by {\it T. basalis}) and the conditional behaviour given the choice (walking, drumming, ovipositing or marking the chosen egg). We consider multi-state models in two successive stages to calculate double transition probabilities, and the statistical methodology is based on the maximum likelihood procedure. Using the Cox model and assuming a stationary process, we verified that the treatment effect was significant for the choice, indicating that the two parasitoid species have different choice patterns. For the second stage, i.e. behaviour given the choice, the results also showed the influence of the species on the conditional behaviour, especially for previously parasitised eggs. Specifically, {\it T.podisi} avoids intraspecific competition and makes decisions faster than {\it T. basalis}. In this work, we emphasise the methodological contribution with multi-state models, especially in the context of double transitions.


title: Perturbing Masses: A Study of Centered Co-Circular Configurations in Power-Law n-Body Problems

abstract: This research investigates centered co-circular central configurations in the general power-law potential $n$-body problem. Firstly, there are no such configurations when all masses are equal, except for two; secondly, unless all masses are equal, no such configurations exist when masses can be divided into two sets of equal masses. We adapt Wang's criterion and incorporate insights on cyclic quadrilaterals, alongside mathematical induction.


title: Emergent topological ordered phase for the Ising-XY Model revealed by cluster-updating Monte-Carlo method

abstract: The two-component cold atom systems with anisotropic hopping amplitudes can be phenomenologically described by a two-dimensional Ising-XY coupled model with spatial anisotropy. At low temperatures, theoretical predictions [Phys. Rev. A 72, 053604 (2005)] and [arXiv:0706.1609] indicate the existence of a topological ordered phase characterized by Ising and XY disorder but with 2XY ordering. However, due to ergodic difficulties faced by Monte Carlo methods at low temperatures, this topological phase has not been numerically explored. We propose a linear cluster updating Monte Carlo method, which flips spins without rejection in the anisotropy limit but does not change the energy. Using this scheme and conventional Monte Carlo methods, we succeed in revealing the nature of topological phases with half-vortices and domain walls. In the constructed global phase diagram, Ising and XY type transitions are very close to each other and differ significantly from the schematic phase diagram reported earlier. We also propose and explore a wide range of quantities, including magnetism, superfluidity, specific heat, susceptibility, and even percolation susceptibility, and obtain consistent results. Furthermore, we observe first-order transitions characterized by common intersection points in magnetizations for different system sizes, as opposed to the conventional phase transition where Binder cumulants of various sizes share common intersections. The results are useful to help cold atom experiments explore the half-vortex topological phase.


title: Flow Morphology of a Supersonic Gravitating Sphere

abstract: Stars and planets move supersonically in a gaseous medium during planetary engulfment, stellar interactions and within protoplanetary disks. For a nearly uniform medium, the relevant parameters are the Mach number and the size of the body, $R$, relative to its accretion radius, $R_A$. Over many decades, numerical and analytical work has characterized the flow, the drag on the body and the possible suite of instabilities. Only a limited amount of work has treated the stellar boundary as it is in many of these astrophysical settings, a hard sphere at $R$. Thus we present new 3-D Athena++ hydrodynamic calculations for a large range of parameters. For $R_A\ll R$, the results are as expected for pure hydrodynamics with minimal impact from gravity, which we verify by comparing to experimental wind tunnel data in air. When $R_A\approx R$, a hydrostatically-supported separation bubble forms behind the gravitating body, exerting significant pressure on the sphere and driving a recompression shock which intersects with the bow shock. For $R_A\gg R$, the bubble transitions into an isentropic, spherically-symmetric halo, as seen in earlier works. These two distinct regimes of flow morphology may be treated separately in terms of their shock stand-off distance and drag coefficients. Most importantly for astrophysical applications, we propose a new formula for the dynamical friction which depends on the ratio of the shock stand-off distance to $R_A$. That exploration also reveals the minimum size of the simulation domain needed to accurately capture the deflection of incoming streamlines due to gravity.

categories: astro-ph.SR astro-ph.EP astro-ph.GA physics.flu-dyn


title: HWD: A Novel Evaluation Score for Styled Handwritten Text Generation

abstract: Styled Handwritten Text Generation (Styled HTG) is an important task in document analysis, aiming to generate text images with the handwriting of given reference images. In recent years, there has been significant progress in the development of deep learning models for tackling this task. Being able to measure the performance of HTG models via a meaningful and representative criterion is key for fostering the development of this research topic. However, despite the current adoption of scores for natural image generation evaluation, assessing the quality of generated handwriting remains challenging. In light of this, we devise the Handwriting Distance (HWD), tailored for HTG evaluation. In particular, it works in the feature space of a network specifically trained to extract handwriting style features from the variable-lenght input images and exploits a perceptual distance to compare the subtle geometric features of handwriting. Through extensive experimental evaluation on different word-level and line-level datasets of handwritten text images, we demonstrate the suitability of the proposed HWD as a score for Styled HTG. The pretrained model used as backbone will be released to ease the adoption of the score, aiming to provide a valuable tool for evaluating HTG models and thus contributing to advancing this important research area.


title: On the classification of fine compactified Jacobians of nodal curves

abstract: We introduce a new class of fine compactified Jacobians for nodal curves, that we call fine compactified Jacobians of vine type, or simply fine V-compactified Jacobians. This class is strictly larger than the class of fine classical compactified Jacobians, as constructed by Oda-Seshadri, Simpson, Caporaso and Esteves. Inspired by a recent preprint of Pagani-Tommasi, we characterize fine V-compactified Jacobians as the fine compactified Jacobians that can arise as limits of Jacobians of smooth curves under a one-parameter smoothing of the nodal curve or in its semiuniversal deformation space. Furthermore, fine V-compactified Jacobians are exactly the ones that gives a compactification of the N\'eron model of the Jacobian of the generic fiber of a one-parameter regular smoothing of the nodal curve. Finally, we give a combinatorial characterization of fine V-compactified Jacobians in terms of their poset of orbits for the action of the generalized Jacobian.


title: Formation of a rapidly rotating classical Be-star in a massive close binary system

abstract: This paper investigates the spin-up of a mass-accreting star in a close binary system passing through the first stage of mass exchange in the Hertzsprung gap. Inside an accreting star, angular momentum is carried by meridional circulation and shear turbulence. The circulation carries part of the angular momentum entering the accretor to its surface. The greater the rate of arrival of angular momentum in the accretor is, the greater this part. It is assumed that this part of the angular momentum can be removed by the disk further from the accretor. If the angular momentum in the matter entering the accretor is more than half the Keplerian value, then the angular momentum obtained by the accretor during mass exchange stage does not depend on the rate of arrival of angular momentum. The accretor may have the characteristics of a Be-star immediately after the end of mass exchange.


title: GACE: Geometry Aware Confidence Enhancement for Black-Box 3D Object Detectors on LiDAR-Data

abstract: Widely-used LiDAR-based 3D object detectors often neglect fundamental geometric information readily available from the object proposals in their confidence estimation. This is mostly due to architectural design choices, which were often adopted from the 2D image domain, where geometric context is rarely available. In 3D, however, considering the object properties and its surroundings in a holistic way is important to distinguish between true and false positive detections, e.g. occluded pedestrians in a group. To address this, we present GACE, an intuitive and highly efficient method to improve the confidence estimation of a given black-box 3D object detector. We aggregate geometric cues of detections and their spatial relationships, which enables us to properly assess their plausibility and consequently, improve the confidence estimation. This leads to consistent performance gains over a variety of state-of-the-art detectors. Across all evaluated detectors, GACE proves to be especially beneficial for the vulnerable road user classes, i.e. pedestrians and cyclists.


title: Theory of Mind in Large Language Models: Examining Performance of 11 State-of-the-Art models vs. Children Aged 7-10 on Advanced Tests

abstract: To what degree should we ascribe cognitive capacities to Large Language Models (LLMs), such as the ability to reason about intentions and beliefs known as Theory of Mind (ToM)? Here we add to this emerging debate by (i) testing 11 base- and instruction-tuned LLMs on capabilities relevant to ToM beyond the dominant false-belief paradigm, including non-literal language usage and recursive intentionality; (ii) using newly rewritten versions of standardized tests to gauge LLMs' robustness; (iii) prompting and scoring for open besides closed questions; and (iv) benchmarking LLM performance against that of children aged 7-10 on the same tasks. We find that instruction-tuned LLMs from the GPT family outperform other models, and often also children. Base-LLMs are mostly unable to solve ToM tasks, even with specialized prompting. We suggest that the interlinked evolution and development of language and ToM may help explain what instruction-tuning adds: rewarding cooperative communication that takes into account interlocutor and context. We conclude by arguing for a nuanced perspective on ToM in LLMs.


title: Numerical realization of the Mortensen observer via a Hessian-augmented polynomial approximation of the value function

abstract: Two related numerical schemes for the realization of the Mortensen observer or minimum energy estimator for the state reconstruction of non-linear dynamical systems subject to deterministic disturbances are proposed and compared. Both approaches rely on a polynomial approximation of the value function associated with the energy of the disturbances of the system. Such an approximation is obtained via interpolation considering not only the values but also first and second order derivatives of the value function in a set of sampling points. The scheme is applied to four examples and the results are compared with the well known extended Kalman filter.


title: FA Team at the NTCIR-17 UFO Task

abstract: The FA team participated in the Table Data Extraction (TDE) and Text-to-Table Relationship Extraction (TTRE) tasks of the NTCIR-17 Understanding of Non-Financial Objects in Financial Reports (UFO). This paper reports our approach to solving the problems and discusses the official results. We successfully utilized various enhancement techniques based on the ELECTRA language model to extract valuable data from tables. Our efforts resulted in an impressive TDE accuracy rate of 93.43 %, positioning us in second place on the Leaderboard rankings. This outstanding achievement is a testament to our proposed approach's effectiveness. In the TTRE task, we proposed the rule-based method to extract meaningful relationships between the text and tables task and confirmed the performance.


title: SemanticBoost: Elevating Motion Generation with Augmented Textual Cues

abstract: Current techniques face difficulties in generating motions from intricate semantic descriptions, primarily due to insufficient semantic annotations in datasets and weak contextual understanding. To address these issues, we present SemanticBoost, a novel framework that tackles both challenges simultaneously. Our framework comprises a Semantic Enhancement module and a Context-Attuned Motion Denoiser (CAMD). The Semantic Enhancement module extracts supplementary semantics from motion data, enriching the dataset's textual description and ensuring precise alignment between text and motion data without depending on large language models. On the other hand, the CAMD approach provides an all-encompassing solution for generating high-quality, semantically consistent motion sequences by effectively capturing context information and aligning the generated motion with the given textual descriptions. Distinct from existing methods, our approach can synthesize accurate orientational movements, combined motions based on specific body part descriptions, and motions generated from complex, extended sentences. Our experimental results demonstrate that SemanticBoost, as a diffusion-based method, outperforms auto-regressive-based techniques, achieving cutting-edge performance on the Humanml3D dataset while maintaining realistic and smooth motion generation quality.


title: The $q^2$ moments in inclusive semileptonic $B$ decays

abstract: We compute the first moments of the $q^2$ distribution in inclusive semileptonic $B$ decays as functions of the lower cut on $q^2$, confirming a number of results given in the literature and adding the $O(\alpha_s^2\beta_0)$ BLM contributions. We then include the $q^2$-moments recently measured by Belle and Belle II in a global fit to the moments. The new data are compatible with the other measurements and slightly decrease the uncertainty on the nonperturbative parameters and on $|V_{cb}|$. Our updated value is $|V_{cb}|=(41.97\pm 0.48)\times 10^{-3}$.


title: A polynomial-time $\text{OPT}^\epsilon$-approximation algorithm for maximum independent set of connected subgraphs in a planar graph

abstract: In the Maximum Independent Set of Objects problem, we are given an $n$-vertex planar graph $G$ and a family $\mathcal{D}$ of $N$ objects, where each object is a connected subgraph of $G$. The task is to find a subfamily $\mathcal{F} \subseteq \mathcal{D}$ of maximum cardinality that consists of pairwise disjoint objects. This problem is $\mathsf{NP}$-hard and is equivalent to the problem of finding the maximum number of pairwise disjoint polygons in a given family of polygons in the plane. As shown by Adamaszek et al. (J. ACM '19), the problem admits a \emph{quasi-polynomial time approximation scheme} (QPTAS): a $(1-\varepsilon)$-approximation algorithm whose running time is bounded by $2^{\mathrm{poly}(\log(N),1/\epsilon)} \cdot n^{\mathcal{O}(1)}$. Nevertheless, to the best of our knowledge, in the polynomial-time regime only the trivial $\mathcal{O}(N)$-approximation is known for the problem in full generality. In the restricted setting where the objects are pseudolines in the plane, Fox and Pach (SODA '11) gave an $N^{\varepsilon}$-approximation algorithm with running time $N^{2^{\tilde{\mathcal{O}}(1/\varepsilon)}}$, for any $\varepsilon>0$. In this work, we present an $\text{OPT}^{\varepsilon}$-approximation algorithm for the problem that runs in time $N^{\tilde{\mathcal{O}}(1/\varepsilon^2)} n^{\mathcal{O}(1)}$, for any $\varepsilon>0$, thus improving upon the result of Fox and Pach both in terms of generality and in terms of the running time. Our approach combines the methodology of Voronoi separators, introduced by Marx and Pilipczuk (TALG '22), with a new analysis of the approximation factor.


title: Erato: Automatizing Poetry Evaluation

abstract: We present Erato, a framework designed to facilitate the automated evaluation of poetry, including that generated by poetry generation systems. Our framework employs a diverse set of features, and we offer a brief overview of Erato's capabilities and its potential for expansion. Using Erato, we compare and contrast human-authored poetry with automatically-generated poetry, demonstrating its effectiveness in identifying key differences. Our implementation code and software are freely available under the GNU GPLv3 license.


title: Improving Entropy-Based Test-Time Adaptation from a Clustering View

abstract: Domain shift is a common problem in the realistic world, where training data and test data follow different data distributions. To deal with this problem, fully test-time adaptation (TTA) leverages the unlabeled data encountered during test time to adapt the model. In particular, entropy-based TTA (EBTTA) methods, which minimize the prediction's entropy on test samples, have shown great success. In this paper, we introduce a new clustering perspective on the EBTTA. It is an iterative algorithm: 1) in the assignment step, the forward process of the EBTTA models is the assignment of labels for these test samples, and 2) in the updating step, the backward process is the update of the model via the assigned samples. This new perspective allows us to explore how entropy minimization influences test-time adaptation. Accordingly, this observation can guide us to put forward the improvement of EBTTA. We propose to improve EBTTA from the assignment step and the updating step, where robust label assignment, similarity-preserving constraint, sample selection, and gradient accumulation are proposed to explicitly utilize more information. Experimental results demonstrate that our method can achieve consistent improvements on various datasets. Code is provided in the supplementary material.


title: ChiSCor: A Corpus of Freely Told Fantasy Stories by Dutch Children for Computational Linguistics and Cognitive Science

abstract: In this resource paper we release ChiSCor, a new corpus containing 619 fantasy stories, told freely by 442 Dutch children aged 4-12. ChiSCor was compiled for studying how children render character perspectives, and unravelling language and cognition in development, with computational tools. Unlike existing resources, ChiSCor's stories were produced in natural contexts, in line with recent calls for more ecologically valid datasets. ChiSCor hosts text, audio, and annotations for character complexity and linguistic complexity. Additional metadata (e.g. education of caregivers) is available for one third of the Dutch children. ChiSCor also includes a small set of 62 English stories. This paper details how ChiSCor was compiled and shows its potential for future work with three brief case studies: i) we show that the syntactic complexity of stories is strikingly stable across children's ages; ii) we extend work on Zipfian distributions in free speech and show that ChiSCor obeys Zipf's law closely, reflecting its social context; iii) we show that even though ChiSCor is relatively small, the corpus is rich enough to train informative lemma vectors that allow us to analyse children's language use. We end with a reflection on the value of narrative datasets in computational linguistics.


title: InstructCoder: Instruction Tuning Large Language Models for Code Editing

abstract: Code editing encompasses a variety of pragmatic tasks that developers deal with daily. Despite its relevance and practical usefulness, automatic code editing remains an underexplored area in the evolution of deep learning models, partly due to data scarcity. In this work, we explore the use of Large Language Models (LLMs) to edit code based on user instructions. Evaluated on a novel human-written execution-based benchmark dubbed EditEval, we found current models often struggle to fulfill the instructions. In light of this, we contribute InstructCoder, the first instruction-tuning dataset designed to adapt LLMs for general-purpose code editing, containing high-diversity code-editing tasks such as comment insertion, code optimization, and code refactoring. It consists of over 114,000 instruction-input-output triplets and covers multiple distinct code editing scenarios. The collection process starts with filtered commit data sourced from GitHub Python repositories as seeds. Subsequently, the dataset is systematically expanded through an iterative process, where both seed and generated tasks are used to prompt ChatGPT for more data. Our findings reveal that open-source LLMs fine-tuned on InstructCoder can significantly enhance the accuracy of code edits, exhibiting superior code-editing performance matching advanced proprietary LLMs. The datasets and the source code are publicly available at https://github.com/qishenghu/CodeInstruct.


title: Tuning Electroluminescence from Functionalized SWCNT Networks further into the Near-Infrared

abstract: Near-infrared electroluminescence from carbon-based emitters, especially in the second biological window (NIR-II) or at telecommunication wavelengths, is difficult to achieve. Single-walled carbon nanotubes (SWCNTs) have been proposed as a possible solution due to their tunable and narrowband emission in the near-infrared and high charge carrier mobilities. Furthermore, the covalent functionalization of SWCNTs with a controlled number of luminescent sp$^{3}$ defects leads to even more red-shifted photoluminescence with enhanced quantum yields. Here, we demonstrate that by tailoring the binding configuration of the introduced sp$^{3}$ defects and hence tuning their optical trap depth we can generate emission from polymer-sorted (6,5) and (7,5) nanotubes that is mainly occurring in the telecommunication O-band (1260-1360 nm). Networks of these functionalized nanotubes are integrated in ambipolar, light-emitting field-effect transistors to yield the corresponding narrowband near-infrared electroluminescence. Further investigation of the current and carrier density-dependent electro- and photoluminescence spectra enable insights into the impact of different sp$^{3}$ defects on charge transport in networks of functionalized SWCNTs.


title: Energy-Aware Adaptive Sampling for Self-Sustainability in Resource-Constrained IoT Devices

abstract: In the ever-growing Internet of Things (IoT) landscape, smart power management algorithms combined with energy harvesting solutions are crucial to obtain self-sustainability. This paper presents an energy-aware adaptive sampling rate algorithm designed for embedded deployment in resource-constrained, battery-powered IoT devices. The algorithm, based on a finite state machine (FSM) and inspired by Transmission Control Protocol (TCP) Reno's additive increase and multiplicative decrease, maximizes sensor sampling rates, ensuring power self-sustainability without risking battery depletion. Moreover, we characterized our solar cell with data acquired over 48 days and used the model created to obtain energy data from an open-source world-wide dataset. To validate our approach, we introduce the EcoTrack device, a versatile device with global navigation satellite system (GNSS) capabilities and Long-Term Evolution Machine Type Communication (LTE-M) connectivity, supporting MQTT protocol for cloud data relay. This multi-purpose device can be used, for instance, as a health and safety wearable, remote hazard monitoring system, or as a global asset tracker. The results, validated on data from three different European cities, show that the proposed algorithm enables self-sustainability while maximizing sampled locations per day. In experiments conducted with a 3000 mAh battery capacity, the algorithm consistently maintained a minimum of 24 localizations per day and achieved peaks of up to 3000.


title: Recaptured Raw Screen Image and Video Demoir\'eing via Channel and Spatial Modulations

abstract: Capturing screen contents by smartphone cameras has become a common way for information sharing. However, these images and videos are often degraded by moir\'e patterns, which are caused by frequency aliasing between the camera filter array and digital display grids. We observe that the moir\'e patterns in raw domain is simpler than those in sRGB domain, and the moir\'e patterns in raw color channels have different properties. Therefore, we propose an image and video demoir\'eing network tailored for raw inputs. We introduce a color-separated feature branch, and it is fused with the traditional feature-mixed branch via channel and spatial modulations. Specifically, the channel modulation utilizes modulated color-separated features to enhance the color-mixed features. The spatial modulation utilizes the feature with large receptive field to modulate the feature with small receptive field. In addition, we build the first well-aligned raw video demoir\'eing (RawVDemoir\'e) dataset and propose an efficient temporal alignment method by inserting alternating patterns. Experiments demonstrate that our method achieves state-of-the-art performance for both image and video demori\'eing. We have released the code and dataset in https://github.com/tju-chengyijia/VD_raw.


title: Semidefinite network games: multiplayer minimax and semidefinite complementarity problems

abstract: Network games are an important class of games that model agent interactions in networked systems, where players are situated at the nodes of a graph and their payoffs depend on the actions taken by their neighbors. We extend the classical framework by considering a game model where the strategies are positive semidefinite matrices having trace one. These (continuous) games can serve as a simple model of quantum strategic interactions. We focus on the zero-sum case, where the sum of all players' payoffs is equal to zero. We establish that in this class of games, Nash equilibria can be characterized as the projection of a spectrahedron, that is, the feasible region of a semidefinite program. Furthermore, we demonstrate that determining whether a game is a semidefinite network game is equivalent to deciding if the value of a semidefinite program is zero. Beyond the zero-sum case, we characterize Nash equilibria as the solutions of a semidefinite linear complementarity problem.


title: A hybrid meta-heuristic for the generation of feasible large-scale course timetables using instance decomposition

abstract: This study introduces a hybrid meta-heuristic for generating feasible course timetables in large-scale scenarios. We conducted tests using our university's instances. The current commercial software often struggles to meet constraints and takes hours to find satisfactory solutions. Our methodology combines adaptive large neighbourhood search, guided local search, variable neighbourhood search, and an innovative instance decomposition technique. Constraint violations from various groups are treated as objective functions to minimize. The search focuses on time slots with the most violations, and if no improvements are observed after a certain number of iterations, the most challenging constraint groups receive new weights to guide the search towards non-dominated solutions, even if the total sum of violations increases. In cases where this approach fails, a shaking phase is employed. The decomposition mechanism works by iteratively introducing curricula to the problem and finding new feasible solutions while considering an expanding set of lectures. Assignments from each iteration can be adjusted in subsequent iterations. Our methodology is tested on real-world instances from our university and random subdivisions. For subdivisions with 400 curricula timetables, decomposition reduced solution times by up to 27%. In real-world instances with 1,288 curricula timetables, the reduction was 18%. Clustering curricula with more common lectures and professors during increments improved solution times by 18% compared to random increments. Using our methodology, viable solutions for real-world instances are found in an average of 21 minutes, whereas the commercial software takes several hours.