title: Where to Move Next: Zero-shot Generalization of LLMs for Next POI Recommendation

abstract: Next Point-of-interest (POI) recommendation provides valuable suggestions for users to explore their surrounding environment. Existing studies rely on building recommendation models from large-scale users' check-in data, which is task-specific and needs extensive computational resources. Recently, the pretrained large language models (LLMs) have achieved significant advancements in various NLP tasks and have also been investigated for recommendation scenarios. However, the generalization abilities of LLMs still are unexplored to address the next POI recommendations, where users' geographical movement patterns should be extracted. Although there are studies that leverage LLMs for next-item recommendations, they fail to consider the geographical influence and sequential transitions. Hence, they cannot effectively solve the next POI recommendation task. To this end, we design novel prompting strategies and conduct empirical studies to assess the capability of LLMs, e.g., ChatGPT, for predicting a user's next check-in. Specifically, we consider several essential factors in human movement behaviors, including user geographical preference, spatial distance, and sequential transitions, and formulate the recommendation task as a ranking problem. Through extensive experiments on two widely used real-world datasets, we derive several key findings. Empirical evaluations demonstrate that LLMs have promising zero-shot recommendation abilities and can provide accurate and reasonable predictions. We also reveal that LLMs cannot accurately comprehend geographical context information and are sensitive to the order of presentation of candidate POIs, which shows the limitations of LLMs and necessitates further research on robust human mobility reasoning mechanisms.


title: Poro 34B and the Blessing of Multilinguality

abstract: The pretraining of state-of-the-art large language models now requires trillions of words of text, which is orders of magnitude more than available for the vast majority of languages. While including text in more than one language is an obvious way to acquire more pretraining data, multilinguality is often seen as a curse, and most model training efforts continue to focus near-exclusively on individual large languages. We believe that multilinguality can be a blessing and that it should be possible to substantially improve over the capabilities of monolingual models for small languages through multilingual training. In this study, we introduce Poro 34B, a 34 billion parameter model trained for 1 trillion tokens of Finnish, English, and programming languages, and demonstrate that a multilingual training approach can produce a model that not only substantially advances over the capabilities of existing models for Finnish, but also excels in translation and is competitive in its class in generating English and programming languages. We release the model parameters, scripts, and data under open licenses at https://huggingface.co/LumiOpen/Poro-34B.


title: Detecting Gender Bias in Course Evaluations

abstract: An outtake from the findnings of a master thesis studying gender bias in course evaluations through the lense of machine learning and nlp. We use different methods to examine and explore the data and find differences in what students write about courses depending on gender of the examiner. Data from English and Swedish courses are evaluated and compared, in order to capture more nuance in the gender bias that might be found. Here we present the results from the work so far, but this is an ongoing project and there is more work to do.


title: Keeping Behavioral Programs Alive: Specifying and Executing Liveness Requirements

abstract: One of the benefits of using executable specifications such as Behavioral Programming (BP) is the ability to align the system implementation with its requirements. This is facilitated in BP by a protocol that allows independent implementation modules that specify what the system may, must, and must not do. By that, each module can enforce a single system requirement, including negative specifications such as "don't do X after Y." The existing BP protocol, however, allows only the enforcement of safety requirements and does not support the execution of liveness properties such as "do X at least three times." To model liveness requirements in BP directly and independently, we propose idioms for tagging states with "must-finish," indicating that tasks are yet to be completed. We show that this idiom allows a direct specification of known requirements patterns from the literature. We also offer semantics and two execution mechanisms, one based on a translation to B\"uchi automata and the other based on a Markov decision process (MDP). The latter approach offers the possibility of utilizing deep reinforcement learning (DRL) algorithms, which bear the potential to handle large software systems effectively. This paper presents a qualitative and quantitative assessment of the proposed approach using a proof-of-concept tool. A formal analysis of the MDP-based execution mechanism is given in an appendix.


title: New polarimetric study of the galactic X-ray burster GX 13+1

abstract: Weakly magnetized neutron stars (WMNS) are complicated sources with challenging phenomenology. For decades, they have been studied via spectrometry and timing. It has been established that the spectrum of WMNSs consists of several components traditionally associated with the accretion disk, the boundary or spreading layer, and the wind and their interactions with each other. Since 2022, WMNSs have been actively observed with the Imaging X-ray Polarimetry Explorer (IXPE). Polarimetric studies provided new information about the behavior and geometry of these sources. One of the most enigmatic sources of the class, galactic X-ray burster GX 13+1 was first observed with IXPE in October 2023. A strongly variable polarization at the level 2-5$\%$ was detected with the source showing a rotation of the polarization angle (PA) that hinted towards the misalignment within the system. The second observation was performed in February 2024 with a complementary observation by Swift/XRT. IXPE measured an overall polarization degree (PD) of 2.5$\%$ and the PA of 24 degrees, and the Swift/XRT data helped us evaluate the galactic absorption and fit the continuum. Here we study the similarities and differences between the polarimetric properties of the source during the two observations. We confirm the expectation of the misalignment in the system and the assignment of the harder component to the boundary layer. We emphasize the importance of the wind in the system. We note the difference in the variation of polarimetric properties with energy and with time.


title: Self-StrAE at SemEval-2024 Task 1: Making Self-Structuring AutoEncoders Learn More With Less

abstract: This paper presents two simple improvements to the Self-Structuring AutoEncoder (Self-StrAE). Firstly, we show that including reconstruction to the vocabulary as an auxiliary objective improves representation quality. Secondly, we demonstrate that increasing the number of independent channels leads to significant improvements in embedding quality, while simultaneously reducing the number of parameters. Surprisingly, we demonstrate that this trend can be followed to the extreme, even to point of reducing the total number of non-embedding parameters to seven. Our system can be pre-trained from scratch with as little as 10M tokens of input data, and proves effective across English, Spanish and Afrikaans.


title: Integrating SystemC-AMS Power Modeling with a RISC-V ISS for Virtual Prototyping of Battery-operated Embedded Devices

abstract: RISC-V cores have gained a lot of popularity over the last few years. However, being quite a recent and novel technology, there is still a gap in the availability of comprehensive simulation frameworks for RISC-V that cover both the functional and extra-functional aspects. This gap hinders progress in the field, as fast yet accurate system-level simulation is crucial for Design Space Exploration (DSE). This work presents an open-source framework designed to tackle this challenge, integrating functional RISC-V simulation (achieved with GVSoC) with SystemC-AMS (used to model extra-functional aspects, in detail power storage and distribution). The combination of GVSoC and SystemC-AMS in a single simulation framework allows to perform a DSE that is dependent on the mutual impact between functional and extra-functional aspects. In our experiments, we validate the framework's effectiveness by creating a virtual prototype of a compact, battery-powered embedded system.


title: Co-Speech Gesture Video Generation via Motion-Decoupled Diffusion Model

abstract: Co-speech gestures, if presented in the lively form of videos, can achieve superior visual effects in human-machine interaction. While previous works mostly generate structural human skeletons, resulting in the omission of appearance information, we focus on the direct generation of audio-driven co-speech gesture videos in this work. There are two main challenges: 1) A suitable motion feature is needed to describe complex human movements with crucial appearance information. 2) Gestures and speech exhibit inherent dependencies and should be temporally aligned even of arbitrary length. To solve these problems, we present a novel motion-decoupled framework to generate co-speech gesture videos. Specifically, we first introduce a well-designed nonlinear TPS transformation to obtain latent motion features preserving essential appearance information. Then a transformer-based diffusion model is proposed to learn the temporal correlation between gestures and speech, and performs generation in the latent motion space, followed by an optimal motion selection module to produce long-term coherent and consistent gesture videos. For better visual perception, we further design a refinement network focusing on missing details of certain areas. Extensive experimental results show that our proposed framework significantly outperforms existing approaches in both motion and video-related evaluations. Our code, demos, and more resources are available at https://github.com/thuhcsi/S2G-MDDiffusion.


title: Confidence-aware Reward Optimization for Fine-tuning Text-to-Image Models

abstract: Fine-tuning text-to-image models with reward functions trained on human feedback data has proven effective for aligning model behavior with human intent. However, excessive optimization with such reward models, which serve as mere proxy objectives, can compromise the performance of fine-tuned models, a phenomenon known as reward overoptimization. To investigate this issue in depth, we introduce the Text-Image Alignment Assessment (TIA2) benchmark, which comprises a diverse collection of text prompts, images, and human annotations. Our evaluation of several state-of-the-art reward models on this benchmark reveals their frequent misalignment with human assessment. We empirically demonstrate that overoptimization occurs notably when a poorly aligned reward model is used as the fine-tuning objective. To address this, we propose TextNorm, a simple method that enhances alignment based on a measure of reward model confidence estimated across a set of semantically contrastive text prompts. We demonstrate that incorporating the confidence-calibrated rewards in fine-tuning effectively reduces overoptimization, resulting in twice as many wins in human evaluation for text-image alignment compared against the baseline reward models.


title: Adaptive Gradient Enhanced Gaussian Process Surrogates for Inverse Problems

abstract: Generating simulated training data needed for constructing sufficiently accurate surrogate models to be used for efficient optimization or parameter identification can incur a huge computational effort in the offline phase. We consider a fully adaptive greedy approach to the computational design of experiments problem using gradient-enhanced Gaussian process regression as surrogates. Designs are incrementally defined by solving an optimization problem for accuracy given a certain computational budget. We address not only the choice of evaluation points but also of required simulation accuracy, both of values and gradients of the forward model. Numerical results show a significant reduction of the computational effort compared to just position-adaptive and static designs as well as a clear benefit of including gradient information into the surrogate training.


title: Attosecond gamma-ray flashes and electron-positron pairs in dyadic laser interaction with micro-wire

abstract: Beams of photons and charged particles of high energy and high brightness find application across a range of disciplines in both fundamental and applied sciences. The interaction of an ultra-intense laser with matter has been shown to be an efficient source of high-energy particles, but typical schemes generate spatially broad distributions with high-divergence and low-brightness. In this paper we report on emission of highly collimated, ultrabright, attosecond $\gamma$-photons and generation of dense electron-positron pairs via a tunable particle generation scheme which utilises the interaction of two high-power lasers with metallic micro-wire target. Irradiating the target with a radially polarised laser pulse first produces a series of high charge, short duration, electron bunches with low transverse momentum. These electron bunches subsequently collide with a counter-propagating high intensity laser. Depending on the intensity of the counter-propagating laser, the scheme can be used to generate either highly collimated ultra-bright MeV-GeV $\gamma$-beams or electron-positron bunches with densities approaching the solid density level.


title: Supervised Autoencoder MLP for Financial Time Series Forecasting

abstract: This paper investigates the enhancement of financial time series forecasting with the use of neural networks through supervised autoencoders, aiming to improve investment strategy performance. It specifically examines the impact of noise augmentation and triple barrier labeling on risk-adjusted returns, using the Sharpe and Information Ratios. The study focuses on the S&P 500 index, EUR/USD, and BTC/USD as the traded assets from January 1, 2010, to April 30, 2022. Findings indicate that supervised autoencoders, with balanced noise augmentation and bottleneck size, significantly boost strategy effectiveness. However, excessive noise and large bottleneck sizes can impair performance, highlighting the importance of precise parameter tuning. This paper also presents a derivation of a novel optimization metric that can be used with triple barrier labeling. The results of this study have substantial policy implications, suggesting that financial institutions and regulators could leverage techniques presented to enhance market stability and investor protection, while also encouraging more informed and strategic investment approaches in various financial sectors.


title: Active Exploration in Bayesian Model-based Reinforcement Learning for Robot Manipulation

abstract: Efficiently tackling multiple tasks within complex environment, such as those found in robot manipulation, remains an ongoing challenge in robotics and an opportunity for data-driven solutions, such as reinforcement learning (RL). Model-based RL, by building a dynamic model of the robot, enables data reuse and transfer learning between tasks with the same robot and similar environment. Furthermore, data gathering in robotics is expensive and we must rely on data efficient approaches such as model-based RL, where policy learning is mostly conducted on cheaper simulations based on the learned model. Therefore, the quality of the model is fundamental for the performance of the posterior tasks. In this work, we focus on improving the quality of the model and maintaining the data efficiency by performing active learning of the dynamic model during a preliminary exploration phase based on maximize information gathering. We employ Bayesian neural network models to represent, in a probabilistic way, both the belief and information encoded in the dynamic model during exploration. With our presented strategies we manage to actively estimate the novelty of each transition, using this as the exploration reward. In this work, we compare several Bayesian inference methods for neural networks, some of which have never been used in a robotics context, and evaluate them in a realistic robot manipulation setup. Our experiments show the advantages of our Bayesian model-based RL approach, with similar quality in the results than relevant alternatives with much lower requirements regarding robot execution steps. Unlike related previous studies that focused the validation solely on toy problems, our research takes a step towards more realistic setups, tackling robotic arm end-tasks.


title: Integrated ultrafast all-optical polariton transistors

abstract: The clock speed of electronic circuits has been stagnant at a few gigahertz for almost two decades because of the breakdown of Dennard scaling, which states that by shrinking the size of transistors they can operate faster while maintaining the same power consumption. Optical computing could overcome this roadblock, but the lack of materials with suitably strong nonlinear interactions needed to realize all-optical switches has, so far, precluded the fabrication of scalable architectures. Recently, microcavities in the strong light-matter interaction regime enabled all-optical transistors which, when used with an embedded organic material, can operate even at room temperature with sub-picosecond switching times, down to the single-photon level. However, the vertical cavity geometry prevents complex circuits with on-chip coupled transistors. Here, by leveraging silicon photonics technology, we show exciton-polariton condensation at ambient conditions in micrometer-sized, fully integrated high-index contrast grating microcavities filled with an optically active polymer. By coupling two resonators and exploiting seeded polariton condensation, we demonstrate ultrafast all-optical transistor action and cascadability. Our experimental findings open the way for scalable, compact all-optical integrated logic circuits that could process optical signals two orders of magnitude faster than their electrical counterparts.


title: Beyond Accuracy: Evaluating the Reasoning Behavior of Large Language Models -- A Survey

abstract: Large language models (LLMs) have recently shown impressive performance on tasks involving reasoning, leading to a lively debate on whether these models possess reasoning capabilities similar to humans. However, despite these successes, the depth of LLMs' reasoning abilities remains uncertain. This uncertainty partly stems from the predominant focus on task performance, measured through shallow accuracy metrics, rather than a thorough investigation of the models' reasoning behavior. This paper seeks to address this gap by providing a comprehensive review of studies that go beyond task accuracy, offering deeper insights into the models' reasoning processes. Furthermore, we survey prevalent methodologies to evaluate the reasoning behavior of LLMs, emphasizing current trends and efforts towards more nuanced reasoning analyses. Our review suggests that LLMs tend to rely on surface-level patterns and correlations in their training data, rather than on genuine reasoning abilities. Additionally, we identify the need for further research that delineates the key differences between human and LLM-based reasoning. Through this survey, we aim to shed light on the complex reasoning processes within LLMs.


title: Multidimensional deconvolution with shared bases

abstract: We address the estimation of seismic wavefields by means of Multidimensional Deconvolution (MDD) for various redatuming applications. While offering more accuracy than conventional correlation-based redatuming methods, MDD faces challenges due to the ill-posed nature of the underlying inverse problem and the requirement to handle large, dense, complex-valued matrices. These obstacles have long limited the adoption of MDD in the geophysical community. Recent interest in this technology has spurred the development of new strategies to enhance the robustness of the inversion process and reduce its computational overhead. We present a novel approach that extends the concept of block low-rank approximations, usually applied to linear operators, to simultaneously compress the operator, right-hand side, and unknowns. This technique greatly alleviates the data-heavy nature of MDD. Moreover, since in 3d applications the matrices do not lend themselves to global low rank approximations, we introduce a novel H2-like approximation. We aim to streamline MDD implementations, fostering efficiency and controlling accuracy in wavefield reconstruction. This innovation holds potential for broader applications in the geophysical domain, possibly revolutionizing the analysis of multi-dimensional seismic datasets.


title: On the reduction of Linear Parameter-Varying State-Space models

abstract: This paper presents an overview and comparative study of the state of the art in State-Order Reduction (SOR) and Scheduling Dimension Reduction (SDR) for Linear Parameter-Varying (LPV) State-Space (SS) models, comparing and benchmarking their capabilities, limitations and performance. The use case chosen for these studies is an interconnected network of nonlinear coupled mass spring damper systems with three different configurations, where some spring coefficients are described by arbitrary user-defined static nonlinear functions. For SOR, the following methods are compared: Linear Time-Invariant (LTI), LPV and LFR-based balanced reductions, moment matching and parameter-varying oblique projection. For SDR, the following methods are compared: Principal Component Analysis (PCA), trajectory PCA, Kernel PCA and LTI balanced truncation, autoencoders and deep neural network. The comparison reveals the most suitable reduction methods for the different benchmark configurations, from which we provide use case SOR and SDR guidelines that can be used to choose the best reduction method for a given LPV-SS model.


title: Fast and Adaptive Questionnaires for Voting Advice Applications

abstract: The effectiveness of Voting Advice Applications (VAA) is often compromised by the length of their questionnaires. To address user fatigue and incomplete responses, some applications (such as the Swiss Smartvote) offer a condensed version of their questionnaire. However, these condensed versions can not ensure the accuracy of recommended parties or candidates, which we show to remain below 40%. To tackle these limitations, this work introduces an adaptive questionnaire approach that selects subsequent questions based on users' previous answers, aiming to enhance recommendation accuracy while reducing the number of questions posed to the voters. Our method uses an encoder and decoder module to predict missing values at any completion stage, leveraging a two-dimensional latent space reflective of political science's traditional methods for visualizing political orientations. Additionally, a selector module is proposed to determine the most informative subsequent question based on the voter's current position in the latent space and the remaining unanswered questions. We validated our approach using the Smartvote dataset from the Swiss Federal elections in 2019, testing various spatial models and selection methods to optimize the system's predictive accuracy. Our findings indicate that employing the IDEAL model both as encoder and decoder, combined with a PosteriorRMSE method for question selection, significantly improves the accuracy of recommendations, achieving 74% accuracy after asking the same number of questions as in the condensed version.


title: Bjorken sum rule with analytic coupling

abstract: We found good agreement between the experimental data obtained for the polarized Bjorken sum rule and the predictions of analytic QCD, as well as a strong difference between these data and the results obtained in the framework of perturbative QCD. To satisfy the limit of photoproduction and take into account Gerasimov-Drell-Hearn and Burkhardt-Cottingham sum rules, we develope new representation of the perturbative part of the polarized Bjorken sum rule.


title: Laser mode-hopping assisted all-optical single beam pulsed atomic magnetometer

abstract: We demonstrate an all-optical single beam pulsed atomic magnetometer assisted by laser mode-hopping in a distributed Bragg reflector (DBR) laser. We implement a temporal sequence of the laser current; sinusoidal current modulation including the laser mode-hop current for synchronous optical pumping and the following constant current for paramagnetic Faraday rotation measurements to probe the free induction decay (FID) of transverse $^{87}$Rb spin polarization. Repetitive sudden frequency shifts of 20 GHz around the pressure-broadened $^{87}$Rb spectra originating from laser mode-hopping enables discontinuous optical pumping modulation with a large depth which enhances transverse spin polarization. We achieve a sensitivity of 3.77 pT/Hz$^{1/2}$ in a magnetic field of 14 $\mu$T, limited by the performance of the frequency counter. The Cramer-Rao lower bound (CRLB) of the sensitivity due to the non-magnetic noise such as photon shot-noise is 191 fT/Hz$^{1/2}$. Our approach based on laser mode-hopping can be applied to miniaturization of all-optical atomic magnetometers with sub-pT/Hz$^{1/2}$ sensitivities.


title: Satellite Federated Edge Learning: Architecture Design and Convergence Analysis

abstract: The proliferation of low-earth-orbit (LEO) satellite networks leads to the generation of vast volumes of remote sensing data which is traditionally transferred to the ground server for centralized processing, raising privacy and bandwidth concerns. Federated edge learning (FEEL), as a distributed machine learning approach, has the potential to address these challenges by sharing only model parameters instead of raw data. Although promising, the dynamics of LEO networks, characterized by the high mobility of satellites and short ground-to-satellite link (GSL) duration, pose unique challenges for FEEL. Notably, frequent model transmission between the satellites and ground incurs prolonged waiting time and large transmission latency. This paper introduces a novel FEEL algorithm, named FEDMEGA, tailored to LEO mega-constellation networks. By integrating inter-satellite links (ISL) for intra-orbit model aggregation, the proposed algorithm significantly reduces the usage of low data rate and intermittent GSL. Our proposed method includes a ring all-reduce based intra-orbit aggregation mechanism, coupled with a network flow-based transmission scheme for global model aggregation, which enhances transmission efficiency. Theoretical convergence analysis is provided to characterize the algorithm performance. Extensive simulations show that our FEDMEGA algorithm outperforms existing satellite FEEL algorithms, exhibiting an approximate 30% improvement in convergence rate.


title: A nonperturbative test of nucleation calculations for strong phase transitions

abstract: Nucleation rate computations are of broad importance in particle physics and cosmology. Perturbative calculations are often used to compute the nucleation rate $\Gamma$, but these are incomplete. We perform nonperturbative lattice simulations of nucleation in a scalar field theory with a tree-level barrier, computing a final result extrapolated to the thermodynamic and continuum limits. Although the system in question should be well-described by a complete one-loop perturbative calculation, we find only qualitative agreement with the full perturbative result, with a 20% discrepancy in $|\log \Gamma|$. Our result motivates further testing of the current nucleation paradigm.


title: Procedural Fairness in Machine Learning

abstract: Fairness in machine learning (ML) has received much attention. However, existing studies have mainly focused on the distributive fairness of ML models. The other dimension of fairness, i.e., procedural fairness, has been neglected. In this paper, we first define the procedural fairness of ML models, and then give formal definitions of individual and group procedural fairness. We propose a novel metric to evaluate the group procedural fairness of ML models, called $GPF_{FAE}$, which utilizes a widely used explainable artificial intelligence technique, namely feature attribution explanation (FAE), to capture the decision process of the ML models. We validate the effectiveness of $GPF_{FAE}$ on a synthetic dataset and eight real-world datasets. Our experiments reveal the relationship between procedural and distributive fairness of the ML model. Based on our analysis, we propose a method for identifying the features that lead to the procedural unfairness of the model and propose two methods to improve procedural fairness after identifying unfair features. Our experimental results demonstrate that we can accurately identify the features that lead to procedural unfairness in the ML model, and both of our proposed methods can significantly improve procedural fairness with a slight impact on model performance, while also improving distributive fairness.


title: Real, fake and synthetic faces -- does the coin have three sides?

abstract: With the ever-growing power of generative artificial intelligence, deepfake and artificially generated (synthetic) media have continued to spread online, which creates various ethical and moral concerns regarding their usage. To tackle this, we thus present a novel exploration of the trends and patterns observed in real, deepfake and synthetic facial images. The proposed analysis is done in two parts: firstly, we incorporate eight deep learning models and analyze their performances in distinguishing between the three classes of images. Next, we look to further delve into the similarities and differences between these three sets of images by investigating their image properties both in the context of the entire image as well as in the context of specific regions within the image. ANOVA test was also performed and provided further clarity amongst the patterns associated between the images of the three classes. From our findings, we observe that the investigated deeplearning models found it easier to detect synthetic facial images, with the ViT Patch-16 model performing best on this task with a class-averaged sensitivity, specificity, precision, and accuracy of 97.37%, 98.69%, 97.48%, and 98.25%, respectively. This observation was supported by further analysis of various image properties. We saw noticeable differences across the three category of images. This analysis can help us build better algorithms for facial image generation, and also shows that synthetic, deepfake and real face images are indeed three different classes.


title: Monodromy of generalized Lame equations with Darboux-Treibich-Verdier potentials: A universal law

abstract: The Darboux-Treibich-Verdier (DTV) potential $\sum_{k=0}^{3}n_{k}(n_{k}+1)\wp(z+\tfrac{ \omega_{k}}{2};\tau)$ is well-known as doubly-periodic solutions of the stationary KdV hierarchy (Treibich-Verdier, Duke Math. J. {\bf 68} (1992), 217-236). In this paper, we study the generalized Lam\'{e} equation with the DTV potential \begin{equation*} y^{\prime \prime }(z)=\bigg[ \sum_{k=0}^{3}n_{k}(n_{k}+1)\wp(z+\tfrac{ \omega_{k}}{2};\tau)+B\bigg] y(z),\quad n_{k}\in \mathbb{N} \end{equation*} from the monodromy aspect. We prove that the map from $(\tau, B)$ to the monodromy data $(r,s)$ satisfies a surprising universal law $d\tau\wedge dB\equiv8\pi^2 dr\wedge ds.$ Our proof applies Panlev\'{e} VI equation and modular forms. We also give applications to the algebraic multiplicity of (anti)periodic eigenvalues for the associated Hill operator.


title: Making two particle detectors in flat spacetime communicate quantumly

abstract: A communication protocol with non-zero quantum capacity is found when the two communicating parts are particle detector models in (3+1)-dimensional spacetime. In particular, as detectors, we consider two harmonic oscillators interacting with a scalar field, whose evolution is generalized for whatever background spacetime and whatever spacetime smearing of the detectors. We then specialize to Minkowski spacetime and an initial Minkowski vacuum, considering a rapid interaction between the field and the two detectors, studying the case where the receiver is static and the sender is moving. The possibility to have a quantum capacity greater than zero stems from a relative acceleration between the detectors. Indeed, no reliable quantum communication is possible when the two detectors are static or moving inertially with respect to each other, but a reliable quantum communication can be achieved between a uniformly accelerated sender and an inertial receiver.


title: Consistent treatment of quantum systems with a time-dependent Hilbert space

abstract: We consider some basic problems associated with quantum mechanics of systems having a time-dependent Hilbert space. We provide a consistent treatment of these systems and address the possibility of describing them in terms of a time-independent Hilbert space. We show that in general the Hamiltonian operator does not represent an observable of the system even if it is a self-adjoint operator. This is related to a hidden geometric aspect of quantum mechanics arising from the presence of an operator-valued gauge potential. We also offer a careful treatment of quantum systems whose Hilbert space is obtained by endowing a time-independent vector space with a time-dependent inner product.


title: Scene Adaptive Sparse Transformer for Event-based Object Detection

abstract: While recent Transformer-based approaches have shown impressive performances on event-based object detection tasks, their high computational costs still diminish the low power consumption advantage of event cameras. Image-based works attempt to reduce these costs by introducing sparse Transformers. However, they display inadequate sparsity and adaptability when applied to event-based object detection, since these approaches cannot balance the fine granularity of token-level sparsification and the efficiency of window-based Transformers, leading to reduced performance and efficiency. Furthermore, they lack scene-specific sparsity optimization, resulting in information loss and a lower recall rate. To overcome these limitations, we propose the Scene Adaptive Sparse Transformer (SAST). SAST enables window-token co-sparsification, significantly enhancing fault tolerance and reducing computational overhead. Leveraging the innovative scoring and selection modules, along with the Masked Sparse Window Self-Attention, SAST showcases remarkable scene-aware adaptability: It focuses only on important objects and dynamically optimizes sparsity level according to scene complexity, maintaining a remarkable balance between performance and computational cost. The evaluation results show that SAST outperforms all other dense and sparse networks in both performance and efficiency on two large-scale event-based object detection datasets (1Mpx and Gen1). Code: https://github.com/Peterande/SAST


title: Adversarial Combinatorial Bandits with Switching Costs

abstract: We study the problem of adversarial combinatorial bandit with a switching cost $\lambda$ for a switch of each selected arm in each round, considering both the bandit feedback and semi-bandit feedback settings. In the oblivious adversarial case with $K$ base arms and time horizon $T$, we derive lower bounds for the minimax regret and design algorithms to approach them. To prove these lower bounds, we design stochastic loss sequences for both feedback settings, building on an idea from previous work in Dekel et al. (2014). The lower bound for bandit feedback is $ \tilde{\Omega}\big( (\lambda K)^{\frac{1}{3}} (TI)^{\frac{2}{3}}\big)$ while that for semi-bandit feedback is $ \tilde{\Omega}\big( (\lambda K I)^{\frac{1}{3}} T^{\frac{2}{3}}\big)$ where $I$ is the number of base arms in the combinatorial arm played in each round. To approach these lower bounds, we design algorithms that operate in batches by dividing the time horizon into batches to restrict the number of switches between actions. For the bandit feedback setting, where only the total loss of the combinatorial arm is observed, we introduce the Batched-Exp2 algorithm which achieves a regret upper bound of $\tilde{O}\big((\lambda K)^{\frac{1}{3}}T^{\frac{2}{3}}I^{\frac{4}{3}}\big)$ as $T$ tends to infinity. In the semi-bandit feedback setting, where all losses for the combinatorial arm are observed, we propose the Batched-BROAD algorithm which achieves a regret upper bound of $\tilde{O}\big( (\lambda K)^{\frac{1}{3}} (TI)^{\frac{2}{3}}\big)$.


title: Comparison of Different Elastic Strain Definitions for Largely Deformed SEI of Chemo-Mechanically Coupled Silicon Battery Particles

abstract: Amorphous silicon is a highly promising anode material for next-generation lithium-ion batteries. Large volume changes of the silicon particle have a critical effect on the surrounding solid-electrolyte interphase (SEI) due to repeated fracture and healing during cycling. Based on a thermodynamically consistent chemo-elasto-plastic continuum model we investigate the stress development inside the particle and the SEI. Using the example of a particle with SEI, we apply a higher order finite element method together with a variable-step, variable-order time integration scheme on a nonlinear system of partial differential equations. Starting from a single silicon particle setting, the surrounding SEI is added in a first step with the typically used elastic Green--St-Venant (GSV) strain definition for a purely elastic deformation. For this type of deformation, the definition of the elastic strain is crucial to get reasonable simulation results. In case of the elastic GSV strain, the simulation aborts. We overcome the simulation failure by using the definition of the logarithmic Hencky strain. However, the particle remains unaffected by the elastic strain definitions in the particle domain. Compared to GSV, plastic deformation with the Hencky strain is straightforward to take into account. For the plastic SEI deformation, a rate-independent and a rate-dependent plastic deformation are newly introduced and numerically compared for three half cycles for the example of a radial symmetric particle.


title: Enhancing Robot Navigation Efficiency Using Cellular Automata with Active Cells

abstract: Enhancing robot navigation efficiency is a crucial objective in modern robotics. Robots relying on external navigation systems are often susceptible to electromagnetic interference (EMI) and encounter environmental disturbances, resulting in orientation errors within their surroundings. Therefore, the study employed an internal navigation system to enhance robot navigation efficacy under interference conditions, based on the analysis of the internal parameters and the external signals. This article presents details of the robot's autonomous operation, which allows for setting the robot's trajectory using an embedded map. The robot's navigation process involves counting the number of wheel revolutions as well as adjusting wheel orientation after each straight path section. In this article, an autonomous robot navigation system has been presented that leverages an embedded control navigation map utilising cellular automata with active cells which can effectively navigate in an environment containing various types of obstacles. By analysing the neighbouring cells of the active cell, the cellular environment determines which cell should become active during the robot's next movement step. This approach ensures the robot's independence from external control inputs. Furthermore, the accuracy and speed of the robot's movement have been further enhanced using a hexagonal mosaic for navigation surface mapping. This concept of utilising on cellular automata with active cells has been extended to the navigation of a group of robots on a shared navigation surface, taking into account the intersections of the robots' trajectories over time. To achieve this, a distance control module has been used that records the travelled trajectories in terms of wheel turns and revolutions.


title: Can My Microservice Tolerate an Unreliable Database? Resilience Testing with Fault Injection and Visualization

abstract: In microservice applications, ensuring resilience during database or service disruptions constitutes a significant challenge. While several tools address resilience testing for service failures, there is a notable gap in tools specifically designed for resilience testing of database failures. To bridge this gap, we have developed an extension for fault injection in database clients, which we integrated into Filibuster, an existing tool for fault injection in services within microservice applications. Our tool systematically simulates database disruptions, thereby enabling comprehensive testing and evaluation of application resilience. It is versatile, supporting a range of both SQL and NoSQL database systems, such as Redis, Apache Cassandra, CockroachDB, PostgreSQL, and DynamoDB. A defining feature is its integration during the development phase, complemented by an IntelliJ IDE plugin, which offers developers visual feedback on the types, locations, and impacts of injected faults. A video demonstration of the tool's capabilities is accessible at https://youtu.be/bvaUVCy1m1s.


title: 3D scene generation from scene graphs and self-attention

abstract: Synthesizing realistic and diverse indoor 3D scene layouts in a controllable fashion opens up applications in simulated navigation and virtual reality. As concise and robust representations of a scene, scene graphs have proven to be well-suited as the semantic control on the generated layout. We present a variant of the conditional variational autoencoder (cVAE) model to synthesize 3D scenes from scene graphs and floor plans. We exploit the properties of self-attention layers to capture high-level relationships between objects in a scene, and use these as the building blocks of our model. Our model, leverages graph transformers to estimate the size, dimension and orientation of the objects in a room while satisfying relationships in the given scene graph. Our experiments shows self-attention layers leads to sparser (7.9x compared to Graphto3D) and more diverse scenes (16%).


title: Estimation of the atmospheric absorption profile with isotropic background events observed by Imaging Atmospheric Cherenkov Telescopes

abstract: Atmospheric Cherenkov telescopes rely on the Earth's atmosphere as part of the detector. The presence of clouds affects observations and can introduce biases if not corrected for. Correction methods typically require an atmospheric profile, that can be measured with external atmospheric monitoring devices. We present a novel method for measuring the atmospheric profile using the data from Imaging Atmospheric Cherenkov telescopes directly. The method exploits the comparison of average longitudinal distributions of the registered Cherenkov light between clear atmosphere and cloud presence cases. Using Monte Carlo simulations of a subarray of four Large-Sized Telescopes of the upcoming Cherenkov Telescope Array Observatory and a simple cloud model we evaluate the accuracy of the method in determining the basic cloud parameters. We find that the method can reconstruct the transmission of typical clouds with an absolute accuracy of a few per cent. For low-zenith observations, the height of the cloud centre can be reconstructed with a typical accuracy of a few hundred metres, while the geometrical thickness can be accurately reconstructed only if it is >= 3 km. We also evaluate the robustness of the method against the typical systematic uncertainties affecting atmospheric Cherenkov telescopes.


title: RAVE: Residual Vector Embedding for CLIP-Guided Backlit Image Enhancement

abstract: In this paper we propose a novel modification of Contrastive Language-Image Pre-Training (CLIP) guidance for the task of unsupervised backlit image enhancement. Our work builds on the state-of-the-art CLIP-LIT approach, which learns a prompt pair by constraining the text-image similarity between a prompt (negative/positive sample) and a corresponding image (backlit image/well-lit image) in the CLIP embedding space. Learned prompts then guide an image enhancement network. Based on the CLIP-LIT framework, we propose two novel methods for CLIP guidance. First, we show that instead of tuning prompts in the space of text embeddings, it is possible to directly tune their embeddings in the latent space without any loss in quality. This accelerates training and potentially enables the use of additional encoders that do not have a text encoder. Second, we propose a novel approach that does not require any prompt tuning. Instead, based on CLIP embeddings of backlit and well-lit images from training data, we compute the residual vector in the embedding space as a simple difference between the mean embeddings of the well-lit and backlit images. This vector then guides the enhancement network during training, pushing a backlit image towards the space of well-lit images. This approach further dramatically reduces training time, stabilizes training and produces high quality enhanced images without artifacts, both in supervised and unsupervised training regimes. Additionally, we show that residual vectors can be interpreted, revealing biases in training data, and thereby enabling potential bias correction.


title: A variational approach to the hot spots conjecture

abstract: We review a recent new approach to the study of critical points of Laplacian eigenfunctions. Its core novelty is a non-standard variational principle for the eigenvalues of the Laplacians with Neumann and Dirichlet boundary conditions on bounded, simply connected planar domains. This principle can be used to provide simple proofs of some previously known results on the hot spots conjecture.


title: ASTRA: An Action Spotting TRAnsformer for Soccer Videos

abstract: In this paper, we introduce ASTRA, a Transformer-based model designed for the task of Action Spotting in soccer matches. ASTRA addresses several challenges inherent in the task and dataset, including the requirement for precise action localization, the presence of a long-tail data distribution, non-visibility in certain actions, and inherent label noise. To do so, ASTRA incorporates (a) a Transformer encoder-decoder architecture to achieve the desired output temporal resolution and to produce precise predictions, (b) a balanced mixup strategy to handle the long-tail distribution of the data, (c) an uncertainty-aware displacement head to capture the label variability, and (d) input audio signal to enhance detection of non-visible actions. Results demonstrate the effectiveness of ASTRA, achieving a tight Average-mAP of 66.82 on the test set. Moreover, in the SoccerNet 2023 Action Spotting challenge, we secure the 3rd position with an Average-mAP of 70.21 on the challenge set.


title: Minimize Quantization Output Error with Bias Compensation

abstract: Quantization is a promising method that reduces memory usage and computational intensity of Deep Neural Networks (DNNs), but it often leads to significant output error that hinder model deployment. In this paper, we propose Bias Compensation (BC) to minimize the output error, thus realizing ultra-low-precision quantization without model fine-tuning. Instead of optimizing the non-convex quantization process as in most previous methods, the proposed BC bypasses the step to directly minimize the quantizing output error by identifying a bias vector for compensation. We have established that the minimization of output error through BC is a convex problem and provides an efficient strategy to procure optimal solutions associated with minimal output error,without the need for training or fine-tuning. We conduct extensive experiments on Vision Transformer models and Large Language Models, and the results show that our method notably reduces quantization output error, thereby permitting ultra-low-precision post-training quantization and enhancing the task performance of models. Especially, BC improves the accuracy of ViT-B with 4-bit PTQ4ViT by 36.89% on the ImageNet-1k task, and decreases the perplexity of OPT-350M with 3-bit GPTQ by 5.97 on WikiText2.The code is in https://github.com/GongCheng1919/bias-compensation.


title: $q$-variational H{\"o}rmander functional calculus and Schr{\"o}dinger and wave maximal estimates

abstract: This article is the continuation of the work [DK] where we had proved maximal estimates $$\left\|\sup_{t > 0} |m(tA)f| \right\|_{L^p(\Omega,Y)} \leq C \|f\|_{L^p(\Omega,Y)}$$ for sectorial operators $A$ acting on $L^p(\Omega,Y)$ ($Y$ being a UMD lattice) and admitting a H\"ormander functional calculus(a strengthening of the holomorphic $H^\infty$ calculus to symbols $m$ differentiable on $(0,\infty)$ in a quantified manner), and $m : (0, \infty) \to \mathbb{C}$ being a H\"ormander class symbol with certain decay at $\infty$.In the present article, we show that under the same conditions as above, the scalar function $t \mapsto m(tA)f(x,\omega)$ is of finite $q$-variation with $q > 2$, a.e. $(x,\omega)$.This extends recent works by [BMSW,HHL,HoMa1,HoMa,JSW,LMX] who have considered among others $m(tA) = e^{-tA}$ the semigroup generated by $-A$.As a consequence, we extend estimates for spherical means in euclidean space from [JSW] to the case of UMD lattice-valued spaces.A second main result yields a maximal estimate $$\left\|\sup_{t > 0} |m(tA) f_t| \right\|_{L^p(\Omega,Y)} \leq C \|f_t\|_{L^p(\Omega,Y(\Lambda^\beta))}$$ for the same $A$ and similar conditions on $m$ as above but with $f_t$ depending itself on $t$ such that $t \mapsto f_t(x,\omega)$ belongs to a Sobolev space $\Lambda^\beta$ over $(\mathbb{R}_+, \frac{dt}{t})$.We apply this to show a maximal estimate of the Schr\"odinger (case $A = -\Delta$) or wave (case $A = \sqrt{-\Delta}$) solution propagator $t \mapsto \exp(itA)f$.Then we deduce from it variants of Carleson's problem of pointwise convergence [Car]\[ \exp(itA)f(x,\omega) \to f(x,\omega) \text{ a. e. }(x,\omega) \quad (t \to 0+)\]for $A$ a Fourier multiplier operator or a differential operator on an open domain $\Omega \subseteq \mathbb{R}^d$ with boundary conditions.


title: BOSS Constraints on Massive Particles during Inflation: The Cosmological Collider in Action

abstract: Massive particles leave imprints on primordial non-Gaussianity via couplings to the inflaton, even despite their exponential dilution during inflation: practically, the Universe acts as a Cosmological Collider. We present the first dedicated search for spin-zero particles using BOSS redshift-space galaxy power spectrum and bispectrum multipoles, as well as Planck CMB non-Gaussianity data. We demonstrate that some Cosmological Collider models are well approximated by the standard equilateral and orthogonal parametrization; assuming negligible inflaton self-interactions, this facilitates us translating Planck non-Gaussianity constraints into bounds on Collider models. Many models have signatures that are not degenerate with equilateral and orthogonal non-Gaussianity and thus require dedicated searches. Here, we constrain such models using BOSS three-dimensional redshift-space galaxy clustering data, focusing on spin-zero particles in the principal series and constraining their couplings to the inflaton at varying speed and mass, marginalizing over the unknown inflaton self-interactions. This is made possible through an improvement in Cosmological Bootstrap techniques and the combination of perturbation theory and halo occupation distribution models for galaxy clustering. Our work sets the standard for inflationary spectroscopy with cosmological observations, providing the ultimate link between physics on the largest and smallest scales.


title: Multivariate post-processing of probabilistic sub-seasonal weather regime forecasts

abstract: Reliable forecasts of quasi-stationary, recurrent, and persistent large-scale atmospheric circulation patterns (weather regimes) are crucial for various socio-economic sectors. Despite steady progress, probabilistic weather regime predictions still exhibit biases in the exact timing and amplitude of weather regimes. This study thus aims at advancing probabilistic weather regime predictions in the North Atlantic-European region through ensemble post-processing. Here, we focus on the representation of seven year-round weather regimes in the sub-seasonal to seasonal reforecasts of the European Centre for Medium-Range Weather Forecasts. The manifestation of each of the seven regimes can be expressed by a continuous weather regime index, representing the projection of the instantaneous 500-hPa geopotential height anomalies (Z500A) onto the respective mean regime pattern. We apply a two-step ensemble post-processing involving first univariate ensemble model output statistics and second ensemble copula coupling, which restores the multivariate dependency structure. Compared to current forecast calibration practices, which rely on correcting the Z500 field by the lead time dependent mean bias, our approach extends the forecast skill horizon for daily/instantaneous regime forecasts moderately by 1.2 days to 14.5 days. Additionally, to our knowledge our study is the first to systematically evaluate the multivariate aspects of forecast quality for weather regime forecasts. Our method outperforms current practices in the multivariate aspect, as measured by the energy and variogram score. Still our study shows, that even with advanced post-processing weather regime prediction becomes difficult beyond 14 days, which likely points towards intrinsic limits of predictability for daily/instantaneous regime forecasts. The proposed method can easily be applied to operational weather regime forecasts.


title: Damage Location in Mechanical Structures by Multi-Objective Pattern Search

abstract: We propose a multi-objective global pattern search algorithm for the task of locating and quantifying damage in flexible mechanical structures. This is achieved by identifying eigenfrequencies and eigenmodes from measurements and matching them against the results of a finite element simulation model, which leads to a nonsmooth nonlinear bi-objective parameter estimation problem. A derivative-free optimization algorithm is required since the problem is nonsmooth and also because complex mechanical simulation models are often solved using commercial black-box software. Moreover, the entire set of non-dominated solutions is of interest to practitioners. Most solution approaches published to date are based on meta-heuristics such as genetic algorithms. The proposed multi-objective pattern-search algorithm provides a mathematically well-founded alternative. It features a novel sorting procedure that reduces the complexity in our context. Test runs on two experimental structures with multiple damage scenarios are used to validate the approach. The results demonstrate that the proposed algorithm yields accurate damage locations and requires moderate computational resources. From the engineer's perspective it represents a promising tool for structural health monitoring.


abstract: Continuous graph neural networks (CGNNs) have garnered significant attention due to their ability to generalize existing discrete graph neural networks (GNNs) by introducing continuous dynamics. They typically draw inspiration from diffusion-based methods to introduce a novel propagation scheme, which is analyzed using ordinary differential equations (ODE). However, the implementation of CGNNs requires significant computational power, making them challenging to deploy on battery-powered devices. Inspired by recent spiking neural networks (SNNs), which emulate a biological inference process and provide an energy-efficient neural architecture, we incorporate the SNNs with CGNNs in a unified framework, named Continuous Spiking Graph Neural Networks (COS-GNN). We employ SNNs for graph node representation at each time step, which are further integrated into the ODE process along with time. To enhance information preservation and mitigate information loss in SNNs, we introduce the high-order structure of COS-GNN, which utilizes the second-order ODE for spiking representation and continuous propagation. Moreover, we provide the theoretical proof that COS-GNN effectively mitigates the issues of exploding and vanishing gradients, enabling us to capture long-range dependencies between nodes. Experimental results on graph-based learning tasks demonstrate the effectiveness of the proposed COS-GNN over competitive baselines.


title: Non-ultralocal classical r-matrix structure for 1+1 field analogue of elliptic Calogero-Moser model

abstract: We consider 1+1 field generalization of the elliptic Calogero-Moser model. It is shown that the Lax connection satisfies the classical non-ultralocal $r$-matrix structure of Maillet type. Next, we consider 1+1 field analogue of the spin Calogero-Moser model and its multipole (or multispin) extension. Finally, we discuss the field analogue of the classical IRF-Vertex correspondence, which relates utralocal and non-ultralocal $r$-matrix structures.


title: The glassy structure of reactive supplementary cementitious materials (SCMs) and recycled glass: Contribution of XRD and Raman spectroscopy to their characterization

abstract: This study compares thirteen natural and industrial samples of supplementary or emerging supplementary cementitious materials (SCMs): slag, fly ashes, pozzolan, obsidian, silica fume, and recycled glass. These materials are used or are under consideration for decarbonization in cement plants. XRF, XRD and Raman microspectroscopy were used in order to achieve a deeper understanding of the structural characterization of SCMs. The changes in position and shape of the XRD diffuse halos were compared. Raman spectroscopy was used to study the glass part of the SCM families, to better understand their structure in terms of depolymerization degree, angle, ring size and incorporations into the glass.The chemical composition of each glassy part was also estimated using reverse Bogue calculations. The hump position is correlated with the Raman shift, and with the XRF bulk or with the calculated glass chemical composition of SCMs, in terms of CaO/(SiO2+Al2O3) or network modifiers to formers ratios.


title: Automatic Derivation of an Optimal Task Frame for Learning and Controlling Contact-Rich Tasks

abstract: This study investigates learning from demonstration (LfD) for contact-rich tasks. The procedure for choosing a task frame to express the learned signals for the motion and interaction wrench is often omitted or using expert insight. This article presents a procedure to derive the optimal task frame from motion and wrench data recorded during the demonstration. The procedure is based on two principles that are hypothesized to underpin the control configuration targeted by an expert, and assumes task frame origins and orientations that are fixed to either the world or the robot tool. It is rooted in screw theory, is entirely probabilistic and does not involve any hyperparameters. The procedure was validated by demonstrating several tasks, including surface following and manipulation of articulated objects, showing good agreement between the obtained and the assumed expert task frames. To validate the performance of the learned tasks by a UR10e robot, a constraint-based controller was designed based on the derived task frames and the learned data expressed therein. These experiments showed the effectiveness and versatility of the proposed approach. The task frame derivation approach fills a gap in the state of the art of LfD, bringing LfD for contact-rich tasks closer to practical application.


title: Learning-based model augmentation with LFRs

abstract: Artificial neural networks (ANN) have proven to be effective in dealing with the identification nonlinear models for highly complex systems. To still make use of the prior information available from baseline models derived from, e.g., first-principles (FP), methods have been developed that integrate the prior knowledge into the identification algorithm for the ANN in a variety of methods. These methods have shown better estimation speeds and/or accuracy on unseen data. Among these methods are model augmentation structures. A variety of these structures have been considered in literature, there is however no unifying theory to these. In this paper, we propose a flexible linear-fractional-representation (LFR) based model augmentation structure. This model structure is able to represent many common model augmentation structures, thus unifying them under the proposed model structure. Furthermore, we introduce an identification algorithm capable of estimating the proposed model augmentation structure. The performance and generalization capabilities of the identification algorithm and the augmentation structure is demonstrated on a hardening mass-spring-damper simulation example.


title: Efficient estimation for a smoothing thin plate spline in a two-dimensional space

abstract: Using a deterministic framework allows us to estimate a function with the purpose of interpolating data in spatial statistics. Radial basis functions are commonly used for scattered data interpolation in a d-dimensional space, however, interpolation problems have to deal with dense matrices. For the case of smoothing thin plate splines, we propose an efficient way to address this problem by compressing the dense matrix by an hierarchical matrix ($\mathcal{H}$-matrix) and using the conjugate gradient method to solve the linear system of equations. A simulation study was conducted to assess the effectiveness of the spatial interpolation method. The results indicated that employing an $\mathcal{H}$-matrix along with the conjugate gradient method allows for efficient computations while maintaining a minimal error. We also provide a sensitivity analysis that covers a range of smoothing and compression parameter values, along with a Monte Carlo simulation aimed at quantifying uncertainty in the approximated function. Lastly, we present a comparative study between the proposed approach and thin plate regression using the "mgcv" package of the statistical software R. The comparison results demonstrate similar interpolation performance between the two methods.


title: Activation Steering for Robust Type Prediction in CodeLLMs

abstract: Contemporary LLMs pretrained on code are capable of succeeding at a wide variety of programming tasks. However, their performance is very sensitive to syntactic features, such as the names of variables and types, the structure of code, and presence of type hints. We contribute an inference-time technique to make CodeLLMs more robust to syntactic distractors that are semantically irrelevant. Our methodology relies on activation steering, which involves editing internal model activations to steer the model towards the correct prediction. We contribute a novel way to construct steering vectors by taking inspiration from mutation testing, which constructs minimal semantics-breaking code edits. In contrast, we construct steering vectors from semantics-preserving code edits. We apply our approach to the task of type prediction for the gradually typed languages Python and TypeScript. This approach corrects up to 90% of type mispredictions. Finally, we show that steering vectors calculated from Python activations reliably correct type mispredictions in TypeScript, and vice versa. This result suggests that LLMs may be learning to transfer knowledge of types across programming languages.


title: Construction of quantum codes from $(\gamma,\Delta)$-cyclic codes

abstract: Let $\mathbb{F}_q$ be the finite field of $q=p^m$ elements where $p$ is a prime and $m$ is a positive integer. This paper considers $(\gamma,\Delta)$-cyclic codes over a class of finite commutative non-chain rings $\mathscr{R}_{q,s}=\mathbb{F}_q[v_1,v_2,\dots,v_s]/\langle v_i-v_i^2,v_iv_j=v_jv_i=0\rangle$ where $\gamma$ is an automorphism of $\mathscr{R}_{q,s}$, $\Delta$ is a $\gamma$-derivation of $\mathscr{R}_{q,s}$ and $1\leq i\neq j\leq s$ for a positive integer $s$. Here, we show that a $(\gamma,\Delta)$-cyclic code of length $n$ over $\mathscr{R}_{q,s}$ is the direct sum of $(\theta,\Im)$-cyclic codes of length $n$ over $\mathbb{F}_q$, where $\theta$ is an automorphism of $\mathbb{F}_q$ and $\Im$ is a $\theta$-derivation of $\mathbb{F}_q$. Further, necessary and sufficient conditions for both $(\gamma,\Delta)$-cyclic and $(\theta,\Im)$-cyclic codes to contain their Euclidean duals are established. Finally, we obtain many quantum codes by applying the dual containing criterion on the Gray images of these codes. The obtained codes have better parameters than those available in the literature.


title: On the surface helium abundance of B-type hot subdwarf stars from the WD+MS channel of Type Ia supernovae

abstract: The origin of intermediate helium (He)-rich hot subdwarfs are still unclear. Previous studies have suggested that some surviving Type Ia supernovae (SNe Ia) companions from the white dwarf~+~main-sequence (WD+MS) channel may contribute to the intermediate He-rich hot subdwarfs. However, previous studies ignored the impact of atomic diffusion on the post-explosion evolution of surviving companion stars of SNe Ia, leading to that they could not explain the observed surface He abundance of intermediate He-rich hot subdwarfs. In this work, by taking the atomic diffusion and stellar wind into account, we trace the surviving companions of SNe Ia from the WD+MS channel using the one-dimensional stellar evolution code \textsc{MESA} until they evolve into hot subdwarfs. We find that the surface He-abundances of our surviving companion models during their core He-burning phases are in a range of $-1 \lesssim {\rm log}(N_{\rm He}/N_{\rm H}) \lesssim 0$, which are consistent with those observed in intermediate He-rich hot subdwarfs. This seems to further support that surviving companions of SNe Ia in the WD+MS channel are possible to form some intermediate He-rich hot subdwarfs.


title: Nonlinear stability for active suspensions

abstract: This paper is devoted to the nonlinear analysis of a kinetic model introduced by Saintillan and Shelley to describe suspensions of active rodlike particles in viscous flows. We investigate the stability of the constant state $\Psi(t,x,p) = \frac{1}{4\pi} $ corresponding to a distribution of particles that is homogeneous in space (variable $x \in \mathbb{T}^3$) and uniform in orientation (variable $p \in \mathbb{S}^2$). We prove its nonlinear stability under the optimal condition of linearized spectral stability, without any addition of spatial diffusion. The mathematical novelty and difficulty compared to previous linear studies comes from the presence of a quasilinear term in $x$ due to nonlinear convection. A key feature of our work, which we hope to be of independent interest, is an analysis of enhanced dissipation and mixing properties of the advection diffusion operator $$\partial_t + (p + u(t,x)) \cdot \nabla_x - \nu \Delta_p $$ on $\mathbb{T}^3 \times \mathbb{S}^2$ for a given appropriately small vector field $u$.


title: Humanizing Machine-Generated Content: Evading AI-Text Detection through Adversarial Attack

abstract: With the development of large language models (LLMs), detecting whether text is generated by a machine becomes increasingly challenging in the face of malicious use cases like the spread of false information, protection of intellectual property, and prevention of academic plagiarism. While well-trained text detectors have demonstrated promising performance on unseen test data, recent research suggests that these detectors have vulnerabilities when dealing with adversarial attacks such as paraphrasing. In this paper, we propose a framework for a broader class of adversarial attacks, designed to perform minor perturbations in machine-generated content to evade detection. We consider two attack settings: white-box and black-box, and employ adversarial learning in dynamic scenarios to assess the potential enhancement of the current detection model's robustness against such attacks. The empirical results reveal that the current detection models can be compromised in as little as 10 seconds, leading to the misclassification of machine-generated text as human-written content. Furthermore, we explore the prospect of improving the model's robustness over iterative adversarial learning. Although some improvements in model robustness are observed, practical applications still face significant challenges. These findings shed light on the future development of AI-text detectors, emphasizing the need for more accurate and robust detection methods.


title: Optimizing Offload Performance in Heterogeneous MPSoCs

abstract: Heterogeneous multi-core architectures combine a few "host" cores, optimized for single-thread performance, with many small energy-efficient "accelerator" cores for data-parallel processing, on a single chip. Offloading a computation to the many-core acceleration fabric introduces a communication and synchronization cost which reduces the speedup attainable on the accelerator, particularly for small and fine-grained parallel tasks. We demonstrate that by co-designing the hardware and offload routines, we can increase the speedup of an offloaded DAXPY kernel by as much as 47.9%. Furthermore, we show that it is possible to accurately model the runtime of an offloaded application, accounting for the offload overheads, with as low as 1% MAPE error, enabling optimal offload decisions under offload execution time constraints.


title: A Temporal Graph Model to Study the Dynamics of Collective Behavior and Performance in Team Sports: An Application to Basketball

abstract: In this study, a temporal graph model is designed to model the behavior of collective sports teams based on the networks of player interactions. The main motivation for the model is to integrate the temporal dimension into the analysis of players' passing networks in order to gain deeper insights into the dynamics of system behavior, particularly how a system exploits the degeneracy property to self-regulate. First, the temporal graph model and the entropy measures used to assess the complexity of the dynamics of the network structure are introduced and illustrated. Second, an experiment using basketball data is conducted to investigate the relationship between the complexity level and team performance. This is accomplished by examining the correlations between the entropy measures in a team's behavior and the team's final performance, as well as the link between the relative score compared to that of the opponent and the entropy in the team's behavior. Results indicate positive correlations between entropy measures and final team performance, and threshold values of relative score associated with changes in team behavior -- thereby revealing common and unique team signatures. From a complexity science perspective, the model proves useful for identifying key performance factors in team sports and for studying the effects of given constraints on the exploitation of degeneracy to organize team behavior through various network structures. Future research can easily extend the model and apply it to other types of social networks.


title: Multicore DRAM Bank-& Row-Conflict Bomb for Timing Attacks in Mixed-Criticality Systems

abstract: With the increasing use of multicore platforms to realize mixed-criticality systems, understanding the underlying shared resources, such as the memory hierarchy shared among cores, and achieving isolation between co-executing tasks running on the same platform with different criticality levels becomes relevant. In addition to safety considerations, a malicious entity can exploit shared resources to create timing attacks on critical applications. In this paper, we focus on understanding the shared DRAM dual in-line memory module and created a timing attack, that we named the "bank & row conflict bomb", to target a victim task in a multicore platform. We also created a "navigate" algorithm to understand how victim requests are managed by the Memory Controller and provide valuable inputs for designing the bank & row conflict bomb. We performed experimental tests on a 2nd Gen Intel Xeon Processor with an 8GB DDR4-2666 DRAM module to show that such an attack can produce a significant increase in the execution time of the victim task by about 150%, motivating the need for proper countermeasures to help ensure the safety and security of critical applications.


title: VLRM: Vision-Language Models act as Reward Models for Image Captioning

abstract: In this work, we present an unsupervised method for enhancing an image captioning model (in our case, BLIP2) using reinforcement learning and vision-language models like CLIP and BLIP2-ITM as reward models. The RL-tuned model is able to generate longer and more comprehensive descriptions. Our model reaches impressive 0.90 R@1 CLIP Recall score on MS-COCO Carpathy Test Split. Weights are available at https://huggingface.co/sashakunitsyn/vlrm-blip2-opt-2.7b.


title: Electrically tunable High-Chern-number quasiflat bands in twisted antiferromagnetic topological insulators

abstract: Isolated flat bands with significantly quenched kinetic energy of electrons could give rise to exotic strongly correlated states from electron-electron interactions. More intriguingly, the interplay between topology and flat bands can further lead to richer physical phenomena, which have attracted much interest. Here, taking advantage of the recently proposed intertwined Dirac states induced from the anisotropic coupling between top and bottom surface states of an antiferromagnetic topological insulator thin film, we show the emergence of a high-Chern-number (quasi)flat-band state through Moir\'e engineering of the surface states. Remarkably, the flat bands are isolated from other bands and located near the Fermi level. Furthermore, topological phase transitions between trivial and nontrivial flat-band states can be driven by tuning the out-of-plane electric field. Our work not only proposes a new scheme to realize high-Chern-number flat-band states, but also highlights the versatility of the intertwined Dirac-cone states.


title: Why is the universe not frozen by the quantum Zeno effect?

abstract: We build a discrete model that simulates the ubiquitous competition between the free internal evolution of a two-level system and the decoherence induced by the interaction with its surrounding environment. It is aimed at being as universal as possible, so that no specific Hamiltonian is assumed. This leads to an analytic criterion, depending on the level of short time decoherence, allowing to determine whether the system will freeze due to the Zeno effect. We check this criterion on several classes of functions which correspond to different physical situations. In the most generic case, the free evolution wins over decoherence, thereby explaining why the universe is indeed not frozen.


title: SCANNER: Knowledge-Enhanced Approach for Robust Multi-modal Named Entity Recognition of Unseen Entities

abstract: Recent advances in named entity recognition (NER) have pushed the boundary of the task to incorporate visual signals, leading to many variants, including multi-modal NER (MNER) or grounded MNER (GMNER). A key challenge to these tasks is that the model should be able to generalize to the entities unseen during the training, and should be able to handle the training samples with noisy annotations. To address this obstacle, we propose SCANNER (Span CANdidate detection and recognition for NER), a model capable of effectively handling all three NER variants. SCANNER is a two-stage structure; we extract entity candidates in the first stage and use it as a query to get knowledge, effectively pulling knowledge from various sources. We can boost our performance by utilizing this entity-centric extracted knowledge to address unseen entities. Furthermore, to tackle the challenges arising from noisy annotations in NER datasets, we introduce a novel self-distillation method, enhancing the robustness and accuracy of our model in processing training data with inherent uncertainties. Our approach demonstrates competitive performance on the NER benchmark and surpasses existing methods on both MNER and GMNER benchmarks. Further analysis shows that the proposed distillation and knowledge utilization methods improve the performance of our model on various benchmarks.


title: Remark on a theorem of Oguiso

abstract: For a Calabi-Yau variety X, Oguiso gave a useful criterion for primitivity of a self-map of X in terms of the associated linear map on the Neron--Severi space of X. In this short note, we prove a variant of Oguiso's criterion and use it to verify primitivity of a certain birational automorphism of a Calabi--Yau threefold, to which Oguiso's original criterion does not apply.


title: Particle systems for mean reflected BSDEs with jumps

abstract: In this paper, we study the mean reflected backward stochastic differential equations with jump (BSDEJs). We extend the work of Briand and Hibon on the propagation of chaos for mean reflected BSDEs \cite{briand2021particles} to the jump framework. Besides, we study the reflections for the particle system and obtain the rate of of convergence of the particle system towards the deterministic flat solution to the mean reflected BSDEJ.


title: Frustration-induced quantum criticality in Ni-doped CePdAl as revealed by the $\mu$SR technique

abstract: In CePdAl, the 4$f$ moments of cerium arrange to form a geometrically frustrated kagome lattice. Due to frustration, in addition to Kondo- and Ruderman-Kittel-Kasuya-Yosida interactions, this metallic system shows a long-range magnetic order (LRO) with a $T_{\rm N}$ of only 2.7\,K. Upon Ni doping at the Pd sites, $T_{\rm N}$ is further suppressed, to reach zero at a critical concentration $x_c \approx 0.15$. Here, by using muon-spin relaxation and rotation ($\mu$SR), we investigate CePd${1-x}$Ni$_x$Al at a local level for five different Ni-concentrations, both above and below $x_c$. Like the parent CePdAl compound, for $x = 0.05$, we observe an incommensurate LRO, which turns into a quasi-static magnetic order for $x = 0.1$ and 0.14. More interestingly, away from $x_c$, for $x = 0.16$ and 0.18, we still observe a non-Fermi liquid regime, evidenced by a power-law divergence of the longitudinal relaxation at low temperatures. In this case, longitudinal field measurements exhibit a time-field scaling, indicative of a cooperative spin dynamics that persists for $x > x_c$. Furthermore, like the externally applied pressure, the chemical pressure induced by Ni doping suppresses the region below $T^*$, characterized by a spin-liquid like dynamical behavior. Our results suggest that the magnetic properties of CePdAl are similarly affected by the hydrostatic- and the chemical pressure. We also confirm that the unusual non-Fermi liquid regime (compared with conventional quantum critical systems) is due to the presence of frustration that persists up to the highest Ni concentrations.


title: The onset of bar formation in a massive galaxy at $z \sim 3.8$

abstract: We examine the morphological and kinematical properties of SPT-2147, a strongly lensed, massive, dusty, star-forming galaxy at $z = 3.762$. Combining data from JWST, HST, and ALMA, we study the galaxy's stellar emission, dust continuum and gas properties. The imaging reveals a central bar structure in the stars and gas embedded within an extended disc with a spiral arm-like feature. The kinematics confirm the presence of the bar and of the regularly rotating disc. Dynamical modeling yields a dynamical mass, ${M}_{\rm dyn} = (9.7 \pm 2.0) \times 10^{10}$ ${\rm M}_{\odot}$, and a maximum rotational velocity to velocity dispersion ratio, $V / \sigma = 9.8 \pm 1.2$. From multi-band imaging we infer, via SED fitting, a stellar mass, ${M}_{\star} = (6.3 \pm 0.9) \times 10^{10}$ $\rm{M}_{\odot}$, and a star formation rate, ${\rm SFR} = 781 \pm 99$ ${\rm M_{\odot} yr^{-1}}$, after correcting for magnification. Combining these measurements with the molecular gas mass, we derive a baryonic-to-total mass ratio of ${M}_{\rm bar} / {M}_{\rm dyn} = 0.9 \pm 0.2$ within 4.0 kpc. This finding suggests that the formation of bars in galaxies begins earlier in the history of the Universe than previously thought and can also occur in galaxies with elevated gas fractions.


title: Hyperviscosity stabilisation of the RBF-FD solution to natural convection

abstract: The numerical stability of fluid flow is an important topic in computational fluid dynamics as fluid flow simulations usually become numerically unstable in the turbulent regime. Many mesh-based methods have already established numerical dissipation procedures that dampen the effects of the unstable advection term. When it comes to meshless methods, the prominent stabilisation scheme is hyperviscosity. It introduces numerical dissipation in the form of a higher-order Laplacian operator. Many papers have already discussed the general effects of hyperviscosity and its parameters. However, hyperviscosity in flow problems has not yet been analyzed in depth. In this paper, we discuss the effects of hyperviscosity on natural convection flow problems as we approach the turbulent regime.

categories: physics.flu-dyn cs.NA math.NA physics.comp-ph


title: Massive celestial amplitudes and celestial amplitudes beyond four points

abstract: We compute scalar three-point celestial amplitudes involving two and three massive scalars. The three-point coefficient of celestial amplitudes with two massive scalars contains a hypergeometric function, and the one with three massive scalars can be represented as a triple Mellin-Barnes integral. Using these three-point celestial amplitudes, we investigate the conformal block expansions of five- and six-point scalar celestial amplitudes in the comb channel. We observe the presence of two-particle operators in the conformal block expansion of five-point celestial amplitudes, which confirms the previous analysis by taking multi-collinear limit. Moreover, we find that there are new three-particle operators in the conformal block expansion of six-point celestial amplitudes. Based on these findings, we conjecture that exchanges of $n$-particle operators can be observed by considering the comb channel conformal block expansion of $(n+3)$-point massless celestial amplitudes. Finally, we show that a new series of operators appears when turning on the mass of the first incoming particle. The leading operator in this series can be interpreted as a two-particle exchange in the OPE of one massive and one massless scalars.


title: A Rationale-centric Counterfactual Data Augmentation Method for Cross-Document Event Coreference Resolution

abstract: Based on Pre-trained Language Models (PLMs), event coreference resolution (ECR) systems have demonstrated outstanding performance in clustering coreferential events across documents. However, the existing system exhibits an excessive reliance on the `triggers lexical matching' spurious pattern in the input mention pair text. We formalize the decision-making process of the baseline ECR system using a Structural Causal Model (SCM), aiming to identify spurious and causal associations (i.e., rationales) within the ECR task. Leveraging the debiasing capability of counterfactual data augmentation, we develop a rationale-centric counterfactual data augmentation method with LLM-in-the-loop. This method is specialized for pairwise input in the ECR system, where we conduct direct interventions on triggers and context to mitigate the spurious association while emphasizing the causation. Our approach achieves state-of-the-art performance on three popular cross-document ECR benchmarks and demonstrates robustness in out-of-domain scenarios.


title: A note on limiting Calderon-Zygmund theory for transformed $n$-Laplace systems in divergence form

abstract: We consider rotated $n$-Laplace systems on the unit ball $B_1 \subset \mathbb{R}^n$ of the form \begin{align*} -\mathrm{div}\left( Q|\nabla u|^{n-2} \nabla u\right) = \mathrm{div}(G), \end{align*} where $u\in W^{1,n}(B_1;\mathbb{R}^N)$, $Q\in W^{1,n}(B_1;SO(N))$ and $G\in L^{\left( \frac{n}{n-1},q \right)}(B_1;\mathbb{R}^n\otimes \mathbb{R}^N)$ for some $0<q<\frac{n}{n-1}$. We prove that $\nabla u\in L^{(n,q(n-1))}_{loc}$ with estimates. As a corollary, we obtain that solutions to $\Delta_n u \in \mathcal{H}^1$, where $\mathcal{H}^1$ is the Hardy space, have a higher integrability, namely $\nabla u \in L^{(n,n-1)}_{loc}$.


title: SGSH: Stimulate Large Language Models with Skeleton Heuristics for Knowledge Base Question Generation

abstract: Knowledge base question generation (KBQG) aims to generate natural language questions from a set of triplet facts extracted from KB. Existing methods have significantly boosted the performance of KBQG via pre-trained language models (PLMs) thanks to the richly endowed semantic knowledge. With the advance of pre-training techniques, large language models (LLMs) (e.g., GPT-3.5) undoubtedly possess much more semantic knowledge. Therefore, how to effectively organize and exploit the abundant knowledge for KBQG becomes the focus of our study. In this work, we propose SGSH--a simple and effective framework to Stimulate GPT-3.5 with Skeleton Heuristics to enhance KBQG. The framework incorporates "skeleton heuristics", which provides more fine-grained guidance associated with each input to stimulate LLMs to generate optimal questions, encompassing essential elements like the question phrase and the auxiliary verb.More specifically, we devise an automatic data construction strategy leveraging ChatGPT to construct a skeleton training dataset, based on which we employ a soft prompting approach to train a BART model dedicated to generating the skeleton associated with each input. Subsequently, skeleton heuristics are encoded into the prompt to incentivize GPT-3.5 to generate desired questions. Extensive experiments demonstrate that SGSH derives the new state-of-the-art performance on the KBQG tasks.


title: Toward Efficient Visual Gyroscopes: Spherical Moments, Harmonics Filtering, and Masking Techniques for Spherical Camera Applications

abstract: Unlike a traditional gyroscope, a visual gyroscope estimates camera rotation through images. The integration of omnidirectional cameras, offering a larger field of view compared to traditional RGB cameras, has proven to yield more accurate and robust results. However, challenges arise in situations that lack features, have substantial noise causing significant errors, and where certain features in the images lack sufficient strength, leading to less precise prediction results. Here, we address these challenges by introducing a novel visual gyroscope, which combines an analytical method with a neural network approach to provide a more efficient and accurate rotation estimation from spherical images. The presented method relies on three key contributions: an adapted analytical approach to compute the spherical moments coefficients, introduction of masks for better global feature representation, and the use of a multilayer perceptron to adaptively choose the best combination of masks and filters. Experimental results demonstrate superior performance of the proposed approach in terms of accuracy. The paper emphasizes the advantages of integrating machine learning to optimize analytical solutions, discusses limitations, and suggests directions for future research.


title: Improving Bird's Eye View Semantic Segmentation by Task Decomposition

abstract: Semantic segmentation in bird's eye view (BEV) plays a crucial role in autonomous driving. Previous methods usually follow an end-to-end pipeline, directly predicting the BEV segmentation map from monocular RGB inputs. However, the challenge arises when the RGB inputs and BEV targets from distinct perspectives, making the direct point-to-point predicting hard to optimize. In this paper, we decompose the original BEV segmentation task into two stages, namely BEV map reconstruction and RGB-BEV feature alignment. In the first stage, we train a BEV autoencoder to reconstruct the BEV segmentation maps given corrupted noisy latent representation, which urges the decoder to learn fundamental knowledge of typical BEV patterns. The second stage involves mapping RGB input images into the BEV latent space of the first stage, directly optimizing the correlations between the two views at the feature level. Our approach simplifies the complexity of combining perception and generation into distinct steps, equipping the model to handle intricate and challenging scenes effectively. Besides, we propose to transform the BEV segmentation map from the Cartesian to the polar coordinate system to establish the column-wise correspondence between RGB images and BEV maps. Moreover, our method requires neither multi-scale features nor camera intrinsic parameters for depth estimation and saves computational overhead. Extensive experiments on nuScenes and Argoverse show the effectiveness and efficiency of our method. Code is available at https://github.com/happytianhao/TaDe.


title: Synchro-curvature description of $\gamma$-ray light curves and spectra of pulsars: global properties

abstract: This work presents a methodological approach to generate realistic $\gamma$-ray light curves of pulsars, resembling reasonably well the observational ones observed by the Fermi-Large Area Telescope instrument, fitting at the same time their high-energy spectra. The theoretical light curves are obtained from a spectral and geometrical model of the synchro-curvature emission. Despite our model relies on a few effective physical parameters, the synthetic light curves present the same main features observed in the observational $\gamma$-ray light curve zoo, such as the different shapes, variety in the number of peaks, and a diversity of peak widths. The morphological features of the light curves allows us to statistically compare the observed properties. In particular, we find that the proportion on the number of peaks found in our synthetic light curves is in agreement with the observational one provided by the third Fermi-LAT pulsar catalog. We also found that the detection probability due to beaming is much higher for orthogonal rotators (approaching 100%) than for small inclination angles (less than 20%).The small variation on the synthetic skymaps generated for different pulsars indicates that the geometry dominates over timing and spectral properties in shaping the gamma-ray light curves. This means that geometrical parameters like the inclination angle can be in principle constrained by gamma-ray data alone independently on the specific properties of a pulsar. At the same time, we find that $\gamma$-ray spectra seen by different observers can slightly differ, opening the door to constraining the viewing angle of a particular pulsar.


title: Electric corrections to $\pi$-$\pi$ scattering lenghts in the linear sigma model

abstract: In this article we analyze the role of an external electric field, in the weak field approximation, on $\pi$-$\pi$ scattering lengths. The discussion is presented in the frame of the linear sigma model. To achieve this, we take into account all one-loop corrections in the $s$, $t$, and $u$ channels associated with the insertion of a Schwinger propagator for charged pions, focusing on the region characterized by small values of the electric field. Furthermore, one of the novelties of our work is the explicit calculation of box diagrams, which were previously overlooked in discussions regarding magnetic corrections. It turns out that the electric field corrections have an opposite effect with respect to magnetic corrections calculated previously in the literature.


title: First Light Curve Analysis of NSVS 8294044, V1023 Her, and V1397 Her Contact Binary Systems

abstract: The first photometric light curve investigation of the NSVS 8294044, V1023 Her, and V1397 Her binary systems is presented. We used ground-based observations for the NSVS 8294044 system and Transiting Exoplanet Survey Satellite (TESS) data for V1023 Her and V1397 Her. The primary and secondary times of minima were extracted from all the data, and by collecting the literature, a new ephemeris was computed for each system. Linear fits for the O-C diagrams were conducted using the Markov chain Monte Carlo (MCMC) method. Light curve solutions were performed using the PHysics Of Eclipsing BinariEs (PHOEBE) Python code and the MCMC approach. The systems were found to be contact binary stars based on the fillout factor and mass ratio. V1023 Her showed the O'Connell effect, and a cold starspot on the secondary component was required for the light curve solution. The absolute parameters of the system were estimated based on an empirical relationship between orbital period and mass. We presented a new T-M equation based on a sample of 428 contact binary systems and found that our three target systems were in good agreement with the fit. The positions of the systems were also depicted on the M-L, M-R, q-L_{ratio}, and M_{tot}-J_0 diagrams in the logarithmic scales.


title: Towards Enhanced Analysis of Lung Cancer Lesions in EBUS-TBNA -- A Semi-Supervised Video Object Detection Method

abstract: This study aims to establish a computer-aided diagnostic system for lung lesions using endobronchial ultrasound (EBUS) to assist physicians in identifying lesion areas. During EBUS-transbronchial needle aspiration (EBUS-TBNA) procedures, hysicians rely on grayscale ultrasound images to determine the location of lesions. However, these images often contain significant noise and can be influenced by surrounding tissues or blood vessels, making identification challenging. Previous research has lacked the application of object detection models to EBUS-TBNA, and there has been no well-defined solution for the lack of annotated data in the EBUS-TBNA dataset. In related studies on ultrasound images, although models have been successful in capturing target regions for their respective tasks, their training and predictions have been based on two-dimensional images, limiting their ability to leverage temporal features for improved predictions. This study introduces a three-dimensional video-based object detection model. It first generates a set of improved queries using a diffusion model, then captures temporal correlations through an attention mechanism. A filtering mechanism selects relevant information from previous frames to pass to the current frame. Subsequently, a teacher-student model training approach is employed to further optimize the model using unlabeled data. By incorporating various data augmentation and feature alignment, the model gains robustness against interference. Test results demonstrate that this model, which captures spatiotemporal information and employs semi-supervised learning methods, achieves an Average Precision (AP) of 48.7 on the test dataset, outperforming other models. It also achieves an Average Recall (AR) of 79.2, significantly leading over existing models.


title: Adaptive Combinatorial Maximization: Beyond Approximate Greedy Policies

abstract: We study adaptive combinatorial maximization, which is a core challenge in machine learning, with applications in active learning as well as many other domains. We study the Bayesian setting, and consider the objectives of maximization under a cardinality constraint and minimum cost coverage. We provide new comprehensive approximation guarantees that subsume previous results, as well as considerably strengthen them. Our approximation guarantees simultaneously support the maximal gain ratio as well as near-submodular utility functions, and include both maximization under a cardinality constraint and a minimum cost coverage guarantee. In addition, we provided an approximation guarantee for a modified prior, which is crucial for obtaining active learning guarantees that do not depend on the smallest probability in the prior. Moreover, we discover a new parameter of adaptive selection policies, which we term the "maximal gain ratio". We show that this parameter is strictly less restrictive than the greedy approximation parameter that has been used in previous approximation guarantees, and show that it can be used to provide stronger approximation guarantees than previous results. In particular, we show that the maximal gain ratio is never larger than the greedy approximation factor of a policy, and that it can be considerably smaller. This provides a new insight into the properties that make a policy useful for adaptive combinatorial maximization.


title: Fluid Implicit Particle Simulation for CPU and GPU

abstract: One of the current challenges in physically-based simulations, and, more specifically, fluid simulations, is to produce visually appealing results at interactive rates, capable of being used in multiple forms of media. In recent times, a lot of effort has been made with regards to this with the use of multi-core architectures, as many of the computations involved in the algorithms for these simulations are very well suited for these architectures. Although there is a considerable amount of works regarding acceleration techniques in this field, there is yet room to further explore and analyze some of them. To investigate this problem, we surveyed the topic of fluid simulations and some of the recent contributions towards this field. Additionally, we implemented two versions of a fluid simulation algorithm, one on the CPU and the other on the GPU using NVIDIA's CUDA framework, with the intent of gaining a better understanding of the effort needed to move these simulations to a multi-core architecture and the performance gains that we get with it.