title: Sensitivity-Improved Polarization Maps at 40 GHz with CLASS and WMAP data

abstract: Improved polarization measurements at frequencies below 70 GHz with degree-level angular resolution are crucial for advancing our understanding of the Galactic synchrotron radiation and the potential polarized anomalous microwave emission and ultimately benefiting the detection of primordial $B$ modes. In this study, we present sensitivity-improved 40 GHz polarization maps obtained by combining the CLASS 40 GHz and WMAP $Q$-band data through a weighted average in the harmonic domain. The decision to include WMAP $Q$-band data stems from similarities in the bandpasses. Leveraging the accurate large-scale measurements from WMAP $Q$ band and the high-sensitivity information from CLASS 40 GHz band at intermediate scales, the noise level at $\ell\in[30, 100]$ is reduced by a factor of $2-3$ in the map space. A pixel domain analysis of the polarized synchrotron spectral index ($\beta_s$) using WMAP $K$ band and the combined maps (mean and 16/84th percentile across the $\beta_s$ map: $-3.08_{-0.20}^{+0.20}$) reveals a stronger preference for spatial variation (PTE for a uniform $\beta_s$ hypothesis smaller than 0.001) than the results obtained using WMAP $K$ and $Ka$ bands ($-3.08_{-0.14}^{+0.14}$). The cross-power spectra of the combined maps follow the same trend as other low-frequency data, and validation through simulations indicates negligible bias introduced by the combination method (sub-percent level in the power spectra). The products of this work are publicly available on $\mathtt{LAMBDA}$.


title: The boring history of Gaia BH3 from isolated binary evolution

abstract: Gaia BH3 is the first observed dormant black hole (BH) with a mass of $\approx{30}$ M$_\odot$ and represents the first confirmation that such massive BHs are associated with metal-poor stars. Here, we explore the isolated binary formation channel for Gaia BH3 focusing on the old and metal-poor stellar population of the Milky Way halo. We use our open-source population synthesis code SEVN to evolve $3.2 \times 10^8$ binaries exploring 16 sets of parameters. We find that systems like Gaia BH3 form preferentially from binaries initially composed of a massive star ($40-60$ M$_\odot$) and a low mass companion ($<1$ M$_\odot$) in a wide ($P>10^3$ days) and eccentric orbit ($e>0.6$). Such progenitors do not undergo any Roche-lobe overflow episode during their entire evolution, so that the final orbital properties of the BH-star system are essentially determined at the core collapse of the primary star. Low natal kicks ($\approx$ 10~km/s) significantly favour the formation of Gaia BH3-like systems, but high velocity kicks up to $\approx 220$ km/s are also allowed. We estimate the formation efficiency for Gaia BH3-like systems in old ($t>10$ Gyr) and metal-poor ($Z<0.01$) populations to be $4 \times 10^{-8}$ M$_\odot^{-1}$, representing $\approx 3\%$ of the whole simulated BH-star population. We expect up to $\sim 3000$ BH-star systems in the Galactic halo formed through isolated evolution, of which $\sim 100$ are compatible with Gaia BH3 alike. Gaia BH3-like systems represent a common product of isolated binary evolution at low metallicity ($Z<0.01$), but given the steep density profile of the Galactic halo we do not expect more than one in the halo at the observed distance of Gaia BH3. Considering the estimated formation efficiency for both the isolated and dynamical formation channel, we conclude that they are almost equally likely to explain the origin of Gaia BH3.


title: MaPa: Text-driven Photorealistic Material Painting for 3D Shapes

abstract: This paper aims to generate materials for 3D meshes from text descriptions. Unlike existing methods that synthesize texture maps, we propose to generate segment-wise procedural material graphs as the appearance representation, which supports high-quality rendering and provides substantial flexibility in editing. Instead of relying on extensive paired data, i.e., 3D meshes with material graphs and corresponding text descriptions, to train a material graph generative model, we propose to leverage the pre-trained 2D diffusion model as a bridge to connect the text and material graphs. Specifically, our approach decomposes a shape into a set of segments and designs a segment-controlled diffusion model to synthesize 2D images that are aligned with mesh parts. Based on generated images, we initialize parameters of material graphs and fine-tune them through the differentiable rendering module to produce materials in accordance with the textual description. Extensive experiments demonstrate the superior performance of our framework in photorealism, resolution, and editability over existing methods. Project page: https://zju3dv.github.io/MaPa


title: A manufacturable platform for photonic quantum computing

abstract: Whilst holding great promise for low noise, ease of operation and networking, useful photonic quantum computing has been precluded by the need for beyond-state-of-the-art components, manufactured by the millions. Here we introduce a manufacturable platform for quantum computing with photons. We benchmark a set of monolithically-integrated silicon photonics-based modules to generate, manipulate, network, and detect photonic qubits, demonstrating dual-rail photonic qubits with $99.98\% \pm 0.01\%$ state preparation and measurement fidelity, Hong-Ou-Mandel quantum interference between independent photon sources with $99.50\%\pm0.25\%$ visibility, two-qubit fusion with $99.22\%\pm0.12\%$ fidelity, and a chip-to-chip qubit interconnect with $99.72\%\pm0.04\%$ fidelity, not accounting for loss. In addition, we preview a selection of next generation technologies, demonstrating low-loss silicon nitride waveguides and components, fabrication-tolerant photon sources, high-efficiency photon-number-resolving detectors, low-loss chip-to-fiber coupling, and barium titanate electro-optic phase shifters.


title: Tunnel Try-on: Excavating Spatial-temporal Tunnels for High-quality Virtual Try-on in Videos

abstract: Video try-on is a challenging task and has not been well tackled in previous works. The main obstacle lies in preserving the details of the clothing and modeling the coherent motions simultaneously. Faced with those difficulties, we address video try-on by proposing a diffusion-based framework named "Tunnel Try-on." The core idea is excavating a "focus tunnel" in the input video that gives close-up shots around the clothing regions. We zoom in on the region in the tunnel to better preserve the fine details of the clothing. To generate coherent motions, we first leverage the Kalman filter to construct smooth crops in the focus tunnel and inject the position embedding of the tunnel into attention layers to improve the continuity of the generated videos. In addition, we develop an environment encoder to extract the context information outside the tunnels as supplementary cues. Equipped with these techniques, Tunnel Try-on keeps the fine details of the clothing and synthesizes stable and smooth videos. Demonstrating significant advancements, Tunnel Try-on could be regarded as the first attempt toward the commercial-level application of virtual try-on in videos.


title: On liftings of modules of finite projective dimension

abstract: We introduce and study a notion of dimly liftable modules; these are modules that are liftable to the right dimension to a regular local ring. We establish special new cases of Serre's positivity conjecture over ramified regular local rings by proving it for dimly liftable modules. Furthermore, we show that the length of a nonzero finite length dimly liftable module is bounded below by the Hilbert-Samuel multiplicity of the local ring. This establishes special cases of the Length Conjecture of Iyengar-Ma-Walker.


title: Spectrum occupies pseudospectrum for random matrices with diagonal deformation and variance profile

abstract: We consider $n\times n$ non-Hermitian random matrices with independent entries and a variance profile, as well as an additive deterministic diagonal deformation. We show that the support of the asymptotic eigenvalue distribution in the complex plane exactly coincides with the $\varepsilon$-pseudospectrum in the consecutive limits $n \to \infty$ and $\varepsilon \to 0$. Furthermore, we provide a description of this support in terms of a single real-valued function on the complex plane. As a level set of this locally real analytic function, the spectral edge is a real analytic variety of dimension at most one.


title: "Unification" of BSM Searches and SM Measurements: the case of lepton$+MET$ and $m_W$

abstract: We develop the idea that the unprecedented precision in Standard Model (SM) measurements, with further improvement at the HL-LHC, enables new searches for physics Beyond the Standard Model (BSM).As an illustration, we demonstrate that the measured kinematic distributions of the lepton$+MET$ final state not only determine the mass of the $W$ boson, but are also sensitive to light new physics. Such a search for new physics thus requires a simultaneous fit to the BSM and SM parameters, "unifying" searches and measurements at the LHC and Tevatron. In this paper, we complete the program initiated in our earlier work arXiv:2310.13687. In particular, we analyze ($i$) novel decay modes of the $W$ boson with a neutrinophilic invisible scalar or with a heavy neutrino; ($ii$) modified production of $W$ bosons, namely, associated with a hadrophilic invisible $Z^\prime$ gauge boson; and ($iii$) scenarios without an on-shell $W$ boson, such as slepton-sneutrino production in the Minimal Supersymmetric Standard Model (MSSM). Here, we complement our previous MSSM analysis in arXiv:2310.13687 by considering a different kinematic region. Our results highlight that new physics can still be directly discovered at the LHC, including light new physics,via SM precision measurements. Furthermore, we illustrate that such BSM signals are subtle, yet potentially large enough to affect the precision measurements of SM parameters themselves, such as the $W$ boson mass.


title: Low-energy nine-layer rhombohedral stacking of transition metal dichalcogenides

abstract: Transition-metal dichalcogenides (TMDs) show unique physical, optical, and electronic properties. The known phases of TMDs are 2H and 3R in bulk form, 1T and associated reconstructions, and 1H in monolayer form. This paper reports a hypothetical phase, 9R, that may exist in TMDs (Mo, W)(S, Se, Te)$_2$, meeting both dynamical stability and elastic stability criteria. 9R phase has the same space group as 3R, $i.e.$ rhombohedral $R3m$ without inversion symmetry, and has 9 layers in a conventional unit cell. We find that 9R has an energy within 1 meV per formula unit of 3R and can be energetically favored by a particular strain condition. We further calculate the electronic, elastic, piezoelectric, Raman, and second-harmonic generation signatures of 9R TMDs and compare them with the corresponding 2H and 3R phases. 9R has similar properties to 3R but shows distinctive Raman peaks in the low-frequency regime, improved piezoelectric properties, and unique band splitting arising from layer coupling at the conduction band minimum. These distinct properties make 9R an attractive candidate for applications in piezotronics and valleytronics.


title: Enhancing Longitudinal Clinical Trial Efficiency with Digital Twins and Prognostic Covariate-Adjusted Mixed Models for Repeated Measures (PROCOVA-MMRM)

abstract: Clinical trials are critical in advancing medical treatments but often suffer from immense time and financial burden. Advances in statistical methodologies and artificial intelligence (AI) present opportunities to address these inefficiencies. Here we introduce Prognostic Covariate-Adjusted Mixed Models for Repeated Measures (PROCOVA-MMRM) as an advantageous combination of prognostic covariate adjustment (PROCOVA) and Mixed Models for Repeated Measures (MMRM). PROCOVA-MMRM utilizes time-matched prognostic scores generated from AI models to enhance the precision of treatment effect estimators for longitudinal continuous outcomes, enabling reductions in sample size and enrollment times. We first provide a description of the background and implementation of PROCOVA-MMRM, followed by two case study reanalyses where we compare the performance of PROCOVA-MMRM versus the unadjusted MMRM. These reanalyses demonstrate significant improvements in statistical power and precision in clinical indications with unmet medical need, specifically Alzheimer's Disease (AD) and Amyotrophic Lateral Sclerosis (ALS). We also explore the potential for sample size reduction with the prospective implementation of PROCOVA-MMRM, finding that the same or better results could have been achieved with fewer participants in these historical trials if the enhanced precision provided by PROCOVA-MMRM had been prospectively leveraged. We also confirm the robustness of the statistical properties of PROCOVA-MMRM in a variety of realistic simulation scenarios. Altogether, PROCOVA-MMRM represents a rigorous method of incorporating advances in the prediction of time-matched prognostic scores generated by AI into longitudinal analysis, potentially reducing both the cost and time required to bring new treatments to patients while adhering to regulatory standards.


title: On Quasi-Locality and Decay of Correlations for Long-Range Models of Open Quantum Spin Systems

abstract: We consider models of open quantum spin systems with irreversible dynamics and show that general quasi-locality results for long-range models, e.g. as proven for the Heisenberg dynamics associated to quantum systems in [27], naturally extend to this setting. Given these bounds, we provide two applications. First, we use these results to obtain estimates on a strictly local approximation of these finite-volume, irreversible dynamics. Next, we show how these bounds can be used to estimate correlation decay in various states.


title: A tale of two localizations: coexistence of flat bands and Anderson localization in a photonics-inspired amorphous system

abstract: Emerging experimental platforms use amorphousness, a constrained form of disorder, to tailor meta-material properties. We study localization under this type of disorder in a class of $2D$ models generalizing recent experiments on photonic systems. We explore two kinds of localization that emerge in these models: Anderson localization by disorder, and the existence of compact, macroscopically degenerate localized states as in many crystalline flat bands. We find localization properties to depend on the symmetry class within a family of amorphized kagom\'{e} tight-binding models, set by a tunable synthetic magnetic field. The flat-band-like degeneracy innate to kagom\'{e} lattices survives under amorphousness without on-site disorder. This phenomenon arises from the cooperation between the structure of the compact localized states and the geometry of the amorphous graph. For particular values of the field, such states emerge in the amorphous system that were not present on the kagom\'{e} lattice in the same field. For generic states, the standard paradigm of Anderson localization is found to apply as expected for systems with particle-hole symmetry (class D), while a similar interpretation does not extend to our results in the general unitary case (class A). The structure of amorphous graphs, which arise in current photonics experiments, allows exact statements about flat-band-like states, including such states that only exist in amorphous systems, and demonstrates how the qualitative behavior of a disordered system can be tuned at fixed graph topology.


title: Quantum Optimization for the Maximum Cut Problem on a Superconducting Quantum Computer

abstract: Achieving high-quality solutions faster than classical solvers on computationally hard problems is a challenge for quantum optimization to deliver utility. Using a superconducting quantum computer, we experimentally investigate the performance of a hybrid quantum-classical algorithm inspired by semidefinite programming approaches for solving the maximum cut problem on 3-regular graphs up to several thousand variables. We leverage the structure of the input problems to address sizes beyond what current quantum machines can naively handle. We attain an average performance of 99% over a random ensemble of thousands of problem instances. We benchmark the quantum solver against similarly high-performing classical heuristics, including the Gurobi optimizer, simulated annealing, and the Burer-Monteiro algorithm. A runtime analysis shows that the quantum solver on large-scale problems is competitive against Gurobi but short of others. We explore multiple leads to close the gap and discuss prospects for a practical quantum speedup.


title: Spontaneous disentanglement and thermalisation

abstract: The problem of quantum measurement can be partially resolved by incorporating a process of spontaneous disentanglement into quantum dynamics. We propose a modified master equation, which contains a nonlinear term giving rise to both spontaneous disentanglement and thermalisation. We find that the added nonlinear term enables limit cycle steady states, which are prohibited in standard quantum mechanics. This finding suggests that an experimental observation of such a limit cycle steady state can provide an important evidence supporting the spontaneous disentanglement hypothesis.


title: Deepfake Labels Restore Reality, Especially for Those Who Dislike the Speaker

abstract: Deepfake videos create dangerous possibilities for public misinformation. In this experiment (N=204), we investigated whether labeling videos as containing actual or deepfake statements from US President Biden helps participants later differentiate between true and fake information. People accurately recalled 93.8% of deepfake videos and 84.2% of actual videos, suggesting that labeling videos can help combat misinformation. Individuals who identify as Republican and had lower favorability ratings of Biden performed better in distinguishing between actual and deepfake videos, a result explained by the elaboration likelihood model (ELM), which predicts that people who distrust a message source will more critically evaluate the message.


title: Data Quality in Crowdsourcing and Spamming Behavior Detection

abstract: As crowdsourcing emerges as an efficient and cost-effective method for obtaining labels for machine learning datasets, it is important to assess the quality of crowd-provided data, so as to improve analysis performance and reduce biases in subsequent machine learning tasks. Given the lack of ground truth in most cases of crowdsourcing, we refer to data quality as annotators' consistency and credibility. Unlike the simple scenarios where Kappa coefficient and intraclass correlation coefficient usually can apply, online crowdsourcing requires dealing with more complex situations. We introduce a systematic method for evaluating data quality and detecting spamming threats via variance decomposition, and we classify spammers into three categories based on their different behavioral patterns. A spammer index is proposed to assess entire data consistency and two metrics are developed to measure crowd worker's credibility by utilizing the Markov chain and generalized random effects models. Furthermore, we showcase the practicality of our techniques and their advantages by applying them on a face verification task with both simulation and real-world data collected from two crowdsourcing platforms.


title: Physically recurrent neural network for rate and path-dependent heterogeneous materials in a finite strain framework

abstract: In this work, a hybrid physics-based data-driven surrogate model for the microscale analysis of heterogeneous material is investigated. The proposed model benefits from the physics-based knowledge contained in the constitutive models used in the full-order micromodel by embedding them in a neural network. Following previous developments, this paper extends the applicability of the physically recurrent neural network (PRNN) by introducing an architecture suitable for rate-dependent materials in a finite strain framework. In this model, the homogenized deformation gradient of the micromodel is encoded into a set of deformation gradients serving as input to the embedded constitutive models. These constitutive models compute stresses, which are combined in a decoder to predict the homogenized stress, such that the internal variables of the history-dependent constitutive models naturally provide physics-based memory for the network. To demonstrate the capabilities of the surrogate model, we consider a unidirectional composite micromodel with transversely isotropic elastic fibers and elasto-viscoplastic matrix material. The extrapolation properties of the surrogate model trained to replace such micromodel are tested on loading scenarios unseen during training, ranging from different strain-rates to cyclic loading and relaxation. Speed-ups of three orders of magnitude with respect to the runtime of the original micromodel are obtained.


title: Equivariant graph convolutional neural networks for the representation of homogenized anisotropic microstructural mechanical response

abstract: Composite materials with different microstructural material symmetries are common in engineering applications where grain structure, alloying and particle/fiber packing are optimized via controlled manufacturing. In fact these microstructural tunings can be done throughout a part to achieve functional gradation and optimization at a structural level. To predict the performance of particular microstructural configuration and thereby overall performance, constitutive models of materials with microstructure are needed. In this work we provide neural network architectures that provide effective homogenization models of materials with anisotropic components. These models satisfy equivariance and material symmetry principles inherently through a combination of equivariant and tensor basis operations. We demonstrate them on datasets of stochastic volume elements with different textures and phases where the material undergoes elastic and plastic deformation, and show that the these network architectures provide significant performance improvements.


title: NeuroNet: A Novel Hybrid Self-Supervised Learning Framework for Sleep Stage Classification Using Single-Channel EEG

abstract: The classification of sleep stages is a pivotal aspect of diagnosing sleep disorders and evaluating sleep quality. However, the conventional manual scoring process, conducted by clinicians, is time-consuming and prone to human bias. Recent advancements in deep learning have substantially propelled the automation of sleep stage classification. Nevertheless, challenges persist, including the need for large datasets with labels and the inherent biases in human-generated annotations. This paper introduces NeuroNet, a self-supervised learning (SSL) framework designed to effectively harness unlabeled single-channel sleep electroencephalogram (EEG) signals by integrating contrastive learning tasks and masked prediction tasks. NeuroNet demonstrates superior performance over existing SSL methodologies through extensive experimentation conducted across three polysomnography (PSG) datasets. Additionally, this study proposes a Mamba-based temporal context module to capture the relationships among diverse EEG epochs. Combining NeuroNet with the Mamba-based temporal context module has demonstrated the capability to achieve, or even surpass, the performance of the latest supervised learning methodologies, even with a limited amount of labeled data. This study is expected to establish a new benchmark in sleep stage classification, promising to guide future research and applications in the field of sleep analysis.


title: The Future of Scientific Publishing: Automated Article Generation

abstract: This study introduces a novel software tool leveraging large language model (LLM) prompts, designed to automate the generation of academic articles from Python code a significant advancement in the fields of biomedical informatics and computer science. Selected for its widespread adoption and analytical versatility, Python served as a foundational proof of concept; however, the underlying methodology and framework exhibit adaptability across various GitHub repo's underlining the tool's broad applicability (Harper 2024). By mitigating the traditionally time-intensive academic writing process, particularly in synthesizing complex datasets and coding outputs, this approach signifies a monumental leap towards streamlining research dissemination. The development was achieved without reliance on advanced language model agents, ensuring high fidelity in the automated generation of coherent and comprehensive academic content. This exploration not only validates the successful application and efficiency of the software but also projects how future integration of LLM agents which could amplify its capabilities, propelling towards a future where scientific findings are disseminated more swiftly and accessibly.


title: Uncovering the Metaverse within Everyday Environments: a Coarse-to-Fine Approach

abstract: The recent release of the Apple Vision Pro has reignited interest in the metaverse, showcasing the intensified efforts of technology giants in developing platforms and devices to facilitate its growth. As the metaverse continues to proliferate, it is foreseeable that everyday environments will become increasingly saturated with its presence. Consequently, uncovering links to these metaverse items will be a crucial first step to interacting with this new augmented world. In this paper, we address the problem of establishing connections with virtual worlds within everyday environments, especially those that are not readily discernible through direct visual inspection. We introduce a vision-based approach leveraging Artcode visual markers to uncover hidden metaverse links embedded in our ambient surroundings. This approach progressively localises the access points to the metaverse, transitioning from coarse to fine localisation, thus facilitating an exploratory interaction process. Detailed experiments are conducted to study the performance of the proposed approach, demonstrating its effectiveness in Artcode localisation and enabling new interaction opportunities.


title: Exploring Vulnerabilities in Remote VR User Studies

abstract: This position paper explores the possibilities and challenges of using Virtual Reality (VR) in remote user studies. Highlighting the immersive nature of VR, the paper identifies key vulnerabilities, including varying technical proficiency, privacy concerns, ethical considerations, and data security risks. To address these issues, proposed mitigation strategies encompass comprehensive onboarding, prioritized informed consent, implementing privacy-by-design principles, and adherence to ethical guidelines. Secure data handling, including encryption and disposal protocols, is advocated. In conclusion, while remote VR studies present unique opportunities, carefully considering and implementing mitigation strategies is essential to uphold reliability, ethical integrity, and security, ensuring responsible and effective use of VR in user research. Ongoing efforts are crucial for adapting to the evolving landscape of VR technology in user studies.


title: An Off-Policy Reinforcement Learning Algorithm Customized for Multi-Task Fusion in Large-Scale Recommender Systems

abstract: As the last critical stage of RSs, Multi-Task Fusion (MTF) is responsible for combining multiple scores outputted by Multi-Task Learning (MTL) into a final score to maximize user satisfaction, which determines the ultimate recommendation results. Recently, to optimize long-term user satisfaction within a recommendation session, Reinforcement Learning (RL) is used for MTF in the industry. However, the off-policy RL algorithms used for MTF so far have the following severe problems: 1) to avoid out-of-distribution (OOD) problem, their constraints are overly strict, which seriously damage their performance; 2) they are unaware of the exploration policy used for producing training data and never interact with real environment, so only suboptimal policy can be learned; 3) the traditional exploration policies are inefficient and hurt user experience. To solve the above problems, we propose a novel method named IntegratedRL-MTF customized for MTF in large-scale RSs. IntegratedRL-MTF integrates off-policy RL model with our online exploration policy to relax overstrict and complicated constraints, which significantly improves its performance. We also design an extremely efficient exploration policy, which eliminates low-value exploration space and focuses on exploring potential high-value state-action pairs. Moreover, we adopt progressive training mode to further enhance our model's performance with the help of our exploration policy. We conduct extensive offline and online experiments in the short video channel of Tencent News. The results demonstrate that our model outperforms other models remarkably. IntegratedRL-MTF has been fully deployed in our RS and other large-scale RSs in Tencent, which have achieved significant improvements.


title: Leveraging Intra-modal and Inter-modal Interaction for Multi-Modal Entity Alignment

abstract: Multi-modal entity alignment (MMEA) aims to identify equivalent entity pairs across different multi-modal knowledge graphs (MMKGs). Existing approaches focus on how to better encode and aggregate information from different modalities. However, it is not trivial to leverage multi-modal knowledge in entity alignment due to the modal heterogeneity. In this paper, we propose a Multi-Grained Interaction framework for Multi-Modal Entity Alignment (MIMEA), which effectively realizes multi-granular interaction within the same modality or between different modalities. MIMEA is composed of four modules: i) a Multi-modal Knowledge Embedding module, which extracts modality-specific representations with multiple individual encoders; ii) a Probability-guided Modal Fusion module, which employs a probability guided approach to integrate uni-modal representations into joint-modal embeddings, while considering the interaction between uni-modal representations; iii) an Optimal Transport Modal Alignment module, which introduces an optimal transport mechanism to encourage the interaction between uni-modal and joint-modal embeddings; iv) a Modal-adaptive Contrastive Learning module, which distinguishes the embeddings of equivalent entities from those of non-equivalent ones, for each modality. Extensive experiments conducted on two real-world datasets demonstrate the strong performance of MIMEA compared to the SoTA. Datasets and code have been submitted as supplementary materials.


title: Large Language Models for Next Point-of-Interest Recommendation

abstract: The next Point of Interest (POI) recommendation task is to predict users' immediate next POI visit given their historical data. Location-Based Social Network (LBSN) data, which is often used for the next POI recommendation task, comes with challenges. One frequently disregarded challenge is how to effectively use the abundant contextual information present in LBSN data. Previous methods are limited by their numerical nature and fail to address this challenge. In this paper, we propose a framework that uses pretrained Large Language Models (LLMs) to tackle this challenge. Our framework allows us to preserve heterogeneous LBSN data in its original format, hence avoiding the loss of contextual information. Furthermore, our framework is capable of comprehending the inherent meaning of contextual information due to the inclusion of commonsense knowledge. In experiments, we test our framework on three real-world LBSN datasets. Our results show that the proposed framework outperforms the state-of-the-art models in all three datasets. Our analysis demonstrates the effectiveness of the proposed framework in using contextual information as well as alleviating the commonly encountered cold-start and short trajectory problems.


title: Low-Rank Online Dynamic Assortment with Dual Contextual Information

abstract: As e-commerce expands, delivering real-time personalized recommendations from vast catalogs poses a critical challenge for retail platforms. Maximizing revenue requires careful consideration of both individual customer characteristics and available item features to optimize assortments over time. In this paper, we consider the dynamic assortment problem with dual contexts -- user and item features. In high-dimensional scenarios, the quadratic growth of dimensions complicates computation and estimation. To tackle this challenge, we introduce a new low-rank dynamic assortment model to transform this problem into a manageable scale. Then we propose an efficient algorithm that estimates the intrinsic subspaces and utilizes the upper confidence bound approach to address the exploration-exploitation trade-off in online decision making. Theoretically, we establish a regret bound of $\tilde{O}((d_1+d_2)r\sqrt{T})$, where $d_1, d_2$ represent the dimensions of the user and item features respectively, $r$ is the rank of the parameter matrix, and $T$ denotes the time horizon. This bound represents a substantial improvement over prior literature, made possible by leveraging the low-rank structure. Extensive simulations and an application to the Expedia hotel recommendation dataset further demonstrate the advantages of our proposed method.


title: A Continual Relation Extraction Approach for Knowledge Graph Completeness

abstract: Representing unstructured data in a structured form is most significant for information system management to analyze and interpret it. To do this, the unstructured data might be converted into Knowledge Graphs, by leveraging an information extraction pipeline whose main tasks are named entity recognition and relation extraction. This thesis aims to develop a novel continual relation extraction method to identify relations (interconnections) between entities in a data stream coming from the real world. Domain-specific data of this thesis is corona news from German and Austrian newspapers.


title: Exploring Quantum Materials & Applications: A Review

abstract: Current condensed matter research is centered on advanced materials and their distinctive features. The interest in Quantum materials (QMs) continues to increase without any decrease due to their novel phenomenon and potential as platforms for revolutionary new technologies in modern science and technology. This article emphasizes the exploration of diverse devices and applications facilitated by the unique properties of QMs. Encompassing fields like quantum computing, metrology, sensing, energy, and communication, the review highlights their transformative potential. In QMs, the emerging phenomena are governed by quantum confinement, strong electronic correlations, topology, and symmetry, which makes these materials apart, making them exceptional in their own regard. This paper emphasizes their unique properties, different types of QMs, various interdisciplinary applications, and integration with existing technologies. This study provides a concise overview of diverse discoveries and advancements, presenting a prospective outlook on QMs in multiple domains.


title: TICE and normalisation, pour une r{\'e}novation universitaire dans les pays du Sud

abstract: University renovation is a recurring fact generated by permanent technological innovations and new methods of organizing universities and training offers. Technological interoperability standards play a determining role, not only by providing added value in terms of saving space and time, but also by changing educational models and knowledge acquisition processes. The countries of sub-Saharan Africa present an institutional framework and a particular type of university organization which requires an in-depth rereading of their operating methods for a better recovery on the path to renovation through ICT. This document offers avenues for reflection and action frameworks that focus on the achievements of norms and interoperability standards.


title: Large spontaneous valley polarization and anomalous valley Hall effect in antiferromagnetic monolayer $\mathrm{Fe_2CF_2}$

abstract: Superior to ferromagnetic (FM) materials, antiferromagnetic (AFM) materials do not have any net magnetic moment and are robust to external magnetic perturbation with ultra-high dynamic speed. To achieve spontaneous valley polarization and anomalous valley Hall effect (AVHE) in AFM materials is of great significance for potential applications in spintronics and valleytronics. Here, we predict an A-type AFM monolayer $\mathrm{Fe_2CF_2}$ with large spontaneous valley polarization. Monolayer $\mathrm{Fe_2CF_2}$ has zero Berry curvature in momentum space but non-zero layer-locked hidden Berry curvature in real space, which provides the basic conditions for the realization of AVHE. Because $\mathrm{Fe_2CF_2}$ possesses the combined symmetry ($PT$ symmetry) of spatial inversion ($P$) and time reversal ($T$) symmetry, the spin is degenerate, which prevents the AVHE. An out-of-plane external electric field can be used to produce spin splitting due to the introduction of layer-dependent electrostatic potential, and then layer-locked AVHE can be realized in $\mathrm{Fe_2CF_2}$. Moreover, the spin order of spin splitting can be reversed, when the direction of electric field is reversed. It is proved that the AVHE can be achieved in Janus $\mathrm{Fe_2CFCl}$ without external electric field due to intrinsic built-in electric field. Our works provide an AFM monolayer with excellent properties to realize AVHE.


title: KamerRaad: Enhancing Information Retrieval in Belgian National Politics through Hierarchical Summarization and Conversational Interfaces

abstract: KamerRaad is an AI tool that leverages large language models to help citizens interactively engage with Belgian political information. The tool extracts and concisely summarizes key excerpts from parliamentary proceedings, followed by the potential for interaction based on generative AI that allows users to steadily build up their understanding. KamerRaad's front-end, built with Streamlit, facilitates easy interaction, while the back-end employs open-source models for text embedding and generation to ensure accurate and relevant responses. By collecting feedback, we intend to enhance the relevancy of our source retrieval and the quality of our summarization, thereby enriching the user experience with a focus on source-driven dialogue.


title: Revealing and Utilizing In-group Favoritism for Graph-based Collaborative Filtering

abstract: When it comes to a personalized item recommendation system, It is essential to extract users' preferences and purchasing patterns. Assuming that users in the real world form a cluster and there is common favoritism in each cluster, in this work, we introduce Co-Clustering Wrapper (CCW). We compute co-clusters of users and items with co-clustering algorithms and add CF subnetworks for each cluster to extract the in-group favoritism. Combining the features from the networks, we obtain rich and unified information about users. We experimented real world datasets considering two aspects: Finding the number of groups divided according to in-group preference, and measuring the quantity of improvement of the performance.


title: Fractional damping enhances chaos in the nonlinear Helmholtz oscillator

abstract: The main purpose of this paper is to study both the underdamped and the overdamped dynamics of the nonlinear Helmholtz oscillator with a fractional order damping. For that purpose, we use the Grunwald-Letnikov fractional derivative algorithm in order to get the numerical simulations. Here, we investigate the effect of taking the fractional derivative in the dissipative term in function of the parameter a. Our main findings show that the trajectories can remain inside the well or can escape from it depending on a which plays the role of a control parameter. Besides, the parameter a is also relevant for the creation or destruction of chaotic motions. On the other hand, the study of the escape times of the particles from the well, as a result of variations of the initial conditions and the undergoing force F, is reported by the use of visualization techniques such as basins of attraction and bifurcation diagrams, showing a good agreement with previous results. Finally, the study of the escape times versus the fractional parameter a shows an exponential decay which goes to zero when a is larger than one. All the results have been carried out for weak damping where chaotic motions can take place in the non-fractional case and also for a stronger damping (overdamped case), where the influence of the fractional term plays a crucial role to enhance chaotic motions. We expect that these results can be of interest in the field of fractional calculus and its applications.


title: Subdifferential of fuzzy n-cell number valued functions and its applications in optimization problems

abstract: In this paper, we present the concept of subdifferential for fuzzy n-cell number valued functions. Then we state some theorems related to subdifferentiability based on the new definition. Finally, we present some applications emphasized on optimization problems, including the Lagrangian dual problem and minimizing the composite problem.


title: Nested Inheritance Dynamics

abstract: The idea of the inheritance of biological processes, such as the developmental process or the life cycle of an organism, has been discussed in the biology literature, but formal mathematical descriptions and plausible data analysis frameworks are lacking. We introduce an extension of the nested Dirichlet Process (nDP) to a multiscale model to aid in understanding the mechanisms by which biological processes are inherited, remain stable, and are modified across generations. To address these issues, we introduce Nested Inheritance Dynamics Algorithm (NIDA). At its primary level, NIDA encompasses all processes unfolding within an individual organism's lifespan. The secondary level delineates the dynamics through which these processes evolve or remain stable over time. This framework allows for the specification of a physical system model at either scale, thus promoting seamless integration with established models of development and heredity.


title: A Methodology and System For Big-Thick Data Collection

abstract: Pervasive sensors have become an essential component in research for gathering real-world data. Nevertheless, current studies on data collecting predominantly concentrate on the objective perception of reality, frequently disregarding the incorporation of subjective human contributions. We introduce an approach and system tailored for gathering big-thick data, a fusion of extensive sensor data (big data) with qualitative human feedback (thick data). Big-thick data enables effective two-way collaboration between humans and machines by supplying data that enables machine learning from human behaviour and activities, as well as data that captures the human interpretation of their actions. The system comprises of three key components: a) a tool for collecting sensor data and user feedback, b) planning and monitoring components for experiment planning and execution monitoring respectively, and c) a machine-learning component that utilizes the data to enhance human-machine interaction.


title: Assessing biological control method on the progression of anaplasmosis disease in dominant cattle species in the Matabeleland north province Zimbabwe

abstract: This paper presents a compartmental model for the transmission dynamics of Anaplasmosis in resource limited farmers cattle subjected to a biological control method. The study seeks to evaluate the stability and control of cattle herds dynamics relative to finite agitation. Anaplasmosis disease pose a major threat in eradicating cattle population growth in resources limited communities. In gaining the insight of the disease, the following model analysis strategies were used in order to compute simulations, analysis of the model upon varying initial predator population and testing the effects of different predation rate on the disease dynamics. It is essential that the progression of Anaplasmosis be stable after the introduction of tick predators into cattle-tick system because that provides the usability of predation as a control measure. After analysing the effect of different prediction rates on the spread of the disease in resource limited communities the study asserted that tick predators like birds and bacteria have been neglected as contributors to natural mechanism of Anaplasmosis. Furthermore, the study brought to light that predictors have been neglected as major contributors to natural control mechanism of Anaplasmosis in Zimbabwe. Additional numerical simulations showed that predation method can be used in the eradication of Anaplasmosis disease thus improving rural livelihood. Investigation of natural tick enemies and predation behaviour can lead to better control of the Anaplasmosis disease efficiently and effectively. Finally, we recommend the necessity for resource limited farmers to capitalise on the use of biological disease control measures.


title: Exploring Remote Hands-on Support for Collaborative Embedded Systems Development

abstract: Embedded systems development is a complex task that often requires team collaboration. Given the growing market of freelancers and the global shift to remote work, remote collaboration has become a necessity for many developers and clients. While existing communication and coordination tools help users share, discuss, and edit code collaboratively, these tools were specifically designed for software rather than hardware development. In this work, our goal is to explore the design space of remote support tools for embedded systems development. To do this, we interviewed 12 seasoned embedded systems developers regarding their current remote work practices, issues, and needs. We then conducted a user enactment study with a bespoke remote manipulation agent, Handy, as a hypothetical assistant to elicit the types of support developers desire from a collaborator. Our findings describe the scenarios and strategies in which remote work takes place; the support needs and information, coordination, and implementation challenges expressed by developers; and the privacy, control, and trust concerns that developers have when working on their projects with remote physical manipulation tools. This research contributes to the literature by bringing embedded systems development in line with remote, on-demand collaboration and help-seeking in software environments. The empirical basis of this work provides a rich foundation of documented needs, preferences, and desires that can ground future work on remote manipulation agents and enhance collaboration support in the domain of embedded systems development.


title: Autonomous LLM-driven research from data to human-verifiable research papers

abstract: As AI promises to accelerate scientific discovery, it remains unclear whether fully AI-driven research is possible and whether it can adhere to key scientific values, such as transparency, traceability and verifiability. Mimicking human scientific practices, we built data-to-paper, an automation platform that guides interacting LLM agents through a complete stepwise research process, while programmatically back-tracing information flow and allowing human oversight and interactions. In autopilot mode, provided with annotated data alone, data-to-paper raised hypotheses, designed research plans, wrote and debugged analysis codes, generated and interpreted results, and created complete and information-traceable research papers. Even though research novelty was relatively limited, the process demonstrated autonomous generation of de novo quantitative insights from data. For simple research goals, a fully-autonomous cycle can create manuscripts which recapitulate peer-reviewed publications without major errors in about 80-90%, yet as goal complexity increases, human co-piloting becomes critical for assuring accuracy. Beyond the process itself, created manuscripts too are inherently verifiable, as information-tracing allows to programmatically chain results, methods and data. Our work thereby demonstrates a potential for AI-driven acceleration of scientific discovery while enhancing, rather than jeopardizing, traceability, transparency and verifiability.


title: SetCSE: Set Operations using Contrastive Learning of Sentence Embeddings

abstract: Taking inspiration from Set Theory, we introduce SetCSE, an innovative information retrieval framework. SetCSE employs sets to represent complex semantics and incorporates well-defined operations for structured information querying under the provided context. Within this framework, we introduce an inter-set contrastive learning objective to enhance comprehension of sentence embedding models concerning the given semantics. Furthermore, we present a suite of operations, including SetCSE intersection, difference, and operation series, that leverage sentence embeddings of the enhanced model for complex sentence retrieval tasks. Throughout this paper, we demonstrate that SetCSE adheres to the conventions of human language expressions regarding compounded semantics, provides a significant enhancement in the discriminatory capability of underlying sentence embedding models, and enables numerous information retrieval tasks involving convoluted and intricate prompts which cannot be achieved using existing querying methods.


title: Utilizing Large Language Models to Identify Reddit Users Considering Vaping Cessation for Digital Interventions

abstract: The widespread adoption of social media platforms globally not only enhances users' connectivity and communication but also emerges as a vital channel for the dissemination of health-related information, thereby establishing social media data as an invaluable organic data resource for public health research. The surge in popularity of vaping or e-cigarette use in the United States and other countries has caused an outbreak of e-cigarette and vaping use-associated lung injury (EVALI), leading to hospitalizations and fatalities in 2019, highlighting the urgency to comprehend vaping behaviors and develop effective strategies for cession. In this study, we extracted a sample dataset from one vaping sub-community on Reddit to analyze users' quit vaping intentions. Leveraging large language models including both the latest GPT-4 and traditional BERT-based language models for sentence-level quit-vaping intention prediction tasks, this study compares the outcomes of these models against human annotations. Notably, when compared to human evaluators, GPT-4 model demonstrates superior consistency in adhering to annotation guidelines and processes, showcasing advanced capabilities to detect nuanced user quit-vaping intentions that human evaluators might overlook. These preliminary findings emphasize the potential of GPT-4 in enhancing the accuracy and reliability of social media data analysis, especially in identifying subtle users' intentions that may elude human detection.


title: Synthesizing Audio from Silent Video using Sequence to Sequence Modeling

abstract: Generating audio from a video's visual context has multiple practical applications in improving how we interact with audio-visual media - for example, enhancing CCTV footage analysis, restoring historical videos (e.g., silent movies), and improving video generation models. We propose a novel method to generate audio from video using a sequence-to-sequence model, improving on prior work that used CNNs and WaveNet and faced sound diversity and generalization challenges. Our approach employs a 3D Vector Quantized Variational Autoencoder (VQ-VAE) to capture the video's spatial and temporal structures, decoding with a custom audio decoder for a broader range of sounds. Trained on the Youtube8M dataset segment, focusing on specific domains, our model aims to enhance applications like CCTV footage analysis, silent movie restoration, and video generation models.


title: CoSD: Collaborative Stance Detection with Contrastive Heterogeneous Topic Graph Learning

abstract: Stance detection seeks to identify the viewpoints of individuals either in favor or against a given target or a controversial topic. Current advanced neural models for stance detection typically employ fully parametric softmax classifiers. However, these methods suffer from several limitations, including lack of explainability, insensitivity to the latent data structure, and unimodality, which greatly restrict their performance and applications. To address these challenges, we present a novel collaborative stance detection framework called (CoSD) which leverages contrastive heterogeneous topic graph learning to learn topic-aware semantics and collaborative signals among texts, topics, and stance labels for enhancing stance detection. During training, we construct a heterogeneous graph to structurally organize texts and stances through implicit topics via employing latent Dirichlet allocation. We then perform contrastive graph learning to learn heterogeneous node representations, aggregating informative multi-hop collaborative signals via an elaborate Collaboration Propagation Aggregation (CPA) module. During inference, we introduce a hybrid similarity scoring module to enable the comprehensive incorporation of topic-aware semantics and collaborative signals for stance detection. Extensive experiments on two benchmark datasets demonstrate the state-of-the-art detection performance of CoSD, verifying the effectiveness and explainability of our collaborative framework.


title: Regression of Dense Distortion Field from a Single Fingerprint Image

abstract: Skin distortion is a long standing challenge in fingerprint matching, which causes false non-matches. Previous studies have shown that the recognition rate can be improved by estimating the distortion field from a distorted fingerprint and then rectifying it into a normal fingerprint. However, existing rectification methods are based on principal component representation of distortion fields, which is not accurate and are very sensitive to finger pose. In this paper, we propose a rectification method where a self-reference based network is utilized to directly estimate the dense distortion field of distorted fingerprint instead of its low dimensional representation. This method can output accurate distortion fields of distorted fingerprints with various finger poses and distortion patterns. We conducted experiments on FVC2004 DB1\_A, expanded Tsinghua Distorted Fingerprint database (with additional distorted fingerprints in diverse finger poses and distortion patterns) and a latent fingerprint database. Experimental results demonstrate that our proposed method achieves the state-of-the-art rectification performance in terms of distortion field estimation and rectified fingerprint matching.


title: MetaSD: A Unified Framework for Scalable Downscaling of Meteorological Variables in Diverse Situations

abstract: Addressing complex meteorological processes at a fine spatial resolution requires substantial computational resources. To accelerate meteorological simulations, researchers have utilized neural networks to downscale meteorological variables from low-resolution simulations. Despite notable advancements, contemporary cutting-edge downscaling algorithms tailored to specific variables. Addressing meteorological variables in isolation overlooks their interconnectedness, leading to an incomplete understanding of atmospheric dynamics. Additionally, the laborious processes of data collection, annotation, and computational resources required for individual variable downscaling are significant hurdles. Given the limited versatility of existing models across different meteorological variables and their failure to account for inter-variable relationships, this paper proposes a unified downscaling approach leveraging meta-learning. This framework aims to facilitate the downscaling of diverse meteorological variables derived from various numerical models and spatiotemporal scales. Trained at variables consisted of temperature, wind, surface pressure and total precipitation from ERA5 and GFS, the proposed method can be extended to downscale convective precipitation, potential energy, height, humidity and ozone from CFS, S2S and CMIP6 at different spatiotemporal scales, which demonstrating its capability to capture the interconnections among diverse variables. Our approach represents the initial effort to create a generalized downscaling model. Experimental evidence demonstrates that the proposed model outperforms existing top downscaling methods in both quantitative and qualitative assessments.


title: Correcting directional dark-field x-ray imaging artefacts using position-dependent image deblurring and attenuation removal

abstract: In recent years, a novel x-ray imaging modality has emerged that reveals unresolved sample microstructure via a "dark-field image", which provides complementary information to conventional "bright-field" images, such as attenuation and phase-contrast modalities. This x-ray dark-field signal is produced by unresolved microstructures scattering the x-ray beam resulting in localised image blur. Dark-field retrieval techniques extract this blur to reconstruct a dark-field image. Unfortunately, the presence of non-dark-field blur such as source-size blur or the detector point-spread-function can affect the dark-field retrieval as they also blur the experimental image. In addition, dark-field images can be degraded by the artefacts induced by large intensity gradients from attenuation and propagation-based phase contrast, particularly around sample edges. By measuring any non-dark-field blurring across the image plane and removing it from experimental images, as well as removing attenuation and propagation-based phase contrast, we show that a directional dark-field image can be retrieved with fewer artefacts and more consistent quantitative measures. We present the details of these corrections and provide "before and after" directional dark-field images of samples imaged at a synchrotron source. This paper utilises single-grid directional dark-field imaging, but these corrections have the potential to be broadly applied to other x-ray imaging techniques.


title: Quantum Patch-Based Autoencoder for Anomaly Segmentation

abstract: Quantum Machine Learning investigates the possibility of quantum computers enhancing Machine Learning algorithms. Anomaly segmentation is a fundamental task in various domains to identify irregularities at sample level and can be addressed with both supervised and unsupervised methods. Autoencoders are commonly used in unsupervised tasks, where models are trained to reconstruct normal instances efficiently, allowing anomaly identification through high reconstruction errors. While quantum autoencoders have been proposed in the literature, their application to anomaly segmentation tasks remains unexplored. In this paper, we introduce a patch-based quantum autoencoder (QPB-AE) for image anomaly segmentation, with a number of parameters scaling logarithmically with patch size. QPB-AE reconstructs the quantum state of the embedded input patches, computing an anomaly map directly from measurement through a SWAP test without reconstructing the input image. We evaluate its performance across multiple datasets and parameter configurations and compare it against a classical counterpart.


title: Hawking radiation as a manifestation of spontaneous symmetry breaking

abstract: We demonstrate that the black hole evaporation can be modelled as a process where one symmetry of the system is spontaneously broken continuously. We then identify three free-parameters of the system. The sign of one of the free-parameters, governs whether the particles emitted by the black-hole are fermions or bosons. The present model explains why the Black Hole evaporation process is so universal. Interestingly, this universality emerges naturally inside certain modifications of gravity.


title: DeepVARMA: A Hybrid Deep Learning and VARMA Model for Chemical Industry Index Forecasting

abstract: Since the chemical industry index is one of the important indicators to measure the development of the chemical industry, forecasting it is critical for understanding the economic situation and trends of the industry. Taking the multivariable nonstationary series-synthetic material index as the main research object, this paper proposes a new prediction model: DeepVARMA, and its variants Deep-VARMA-re and DeepVARMA-en, which combine LSTM and VARMAX models. The new model firstly uses the deep learning model such as the LSTM remove the trends of the target time series and also learn the representation of endogenous variables, and then uses the VARMAX model to predict the detrended target time series with the embeddings of endogenous variables, and finally combines the trend learned by the LSTM and dependency learned by the VARMAX model to obtain the final predictive values. The experimental results show that (1) the new model achieves the best prediction accuracy by combining the LSTM encoding of the exogenous variables and the VARMAX model. (2) In multivariate non-stationary series prediction, DeepVARMA uses a phased processing strategy to show higher adaptability and accuracy compared to the traditional VARMA model as well as the machine learning models LSTM, RF and XGBoost. (3) Compared with smooth sequence prediction, the traditional VARMA and VARMAX models fluctuate more in predicting non-smooth sequences, while DeepVARMA shows more flexibility and robustness. This study provides more accurate tools and methods for future development and scientific decision-making in the chemical industry.


title: Behaviours of rip cosmological models in $f(Q,C)$ gravity

abstract: In this study, the Universe's rip cosmology theories have been provided for the $f(Q,C)$ gravity theory, where $Q$ and $C$ stand for the non-metricity scalar and boundary term. We assumed $f(Q,C)=\alpha Q^{n}+\beta C$ and analyzed the nature of the physical parameters for the Little Rip, Big Rip and Pseudo Rip models. In the LR and PR models, the EoS parameter exhibits phantom characteristics but remains closely aligned with the $\Lambda$CDM line. After investigating the energy conditions, we recognised that our model violates the strong energy constraint. Avoiding singularity situations has been noted in all of these accelerated models. The characteristics of the jerk and snap parameters have been investigated. Our model provides an effective description of the Universe's evolutionary history and fits well with contemporary cosmic data.


title: Beyond Traditional Threats: A Persistent Backdoor Attack on Federated Learning

abstract: Backdoors on federated learning will be diluted by subsequent benign updates. This is reflected in the significant reduction of attack success rate as iterations increase, ultimately failing. We use a new metric to quantify the degree of this weakened backdoor effect, called attack persistence. Given that research to improve this performance has not been widely noted,we propose a Full Combination Backdoor Attack (FCBA) method. It aggregates more combined trigger information for a more complete backdoor pattern in the global model. Trained backdoored global model is more resilient to benign updates, leading to a higher attack success rate on the test set. We test on three datasets and evaluate with two models across various settings. FCBA's persistence outperforms SOTA federated learning backdoor attacks. On GTSRB, postattack 120 rounds, our attack success rate rose over 50% from baseline. The core code of our method is available at https://github.com/PhD-TaoLiu/FCBA.


title: Momentum exchange method for quantum Boltzmann methods

abstract: The past years have seen a surge in quantum algorithms for computational fluid dynamics (CFD). These algorithms have in common that whilst promising a speed-up in the performance of the algorithm, no specific method of measurement has been suggested. This means that while the algorithms presented in the literature may be promising methods for creating the quantum state that represents the final flow field, an efficient measurement strategy is not available. This paper marks the first quantum method proposed to efficiently calculate quantities of interest (QoIs) from a state vector representing the flow field. In particular, we propose a method to calculate the force acting on an object immersed in the fluid using a quantum version of the momentum exchange method (MEM) that is commonly used in lattice Boltzmann methods to determine the drag and lift coefficients. In order to achieve this we furthermore give a scheme that implements bounce back boundary conditions on a quantum computer, as those are the boundary conditions the momentum exchange method is designed for.


title: VisAnywhere: Developing Multi-platform Scientific Visualization Applications

abstract: Scientists often explore and analyze large-scale scientific simulation data by leveraging two- and three-dimensional visualizations. The data and tasks can be complex and therefore best supported using myriad display technologies, from mobile devices to large high-resolution display walls to virtual reality headsets. Using a simulation of neuron connections in the human brain, we present our work leveraging various web technologies to create a multi-platform scientific visualization application. Users can spread visualization and interaction across multiple devices to support flexible user interfaces and both co-located and remote collaboration. Drawing inspiration from responsive web design principles, this work demonstrates that a single codebase can be adapted to develop scientific visualization applications that operate everywhere.


title: Neural Modes: Self-supervised Learning of Nonlinear Modal Subspaces

abstract: We propose a self-supervised approach for learning physics-based subspaces for real-time simulation. Existing learning-based methods construct subspaces by approximating pre-defined simulation data in a purely geometric way. However, this approach tends to produce high-energy configurations, leads to entangled latent space dimensions, and generalizes poorly beyond the training set. To overcome these limitations, we propose a self-supervised approach that directly minimizes the system's mechanical energy during training. We show that our method leads to learned subspaces that reflect physical equilibrium constraints, resolve overfitting issues of previous methods, and offer interpretable latent space parameters.


title: Attention-aware non-rigid image registration for accelerated MR imaging

abstract: Accurate motion estimation at high acceleration factors enables rapid motion-compensated reconstruction in Magnetic Resonance Imaging (MRI) without compromising the diagnostic image quality. In this work, we introduce an attention-aware deep learning-based framework that can perform non-rigid pairwise registration for fully sampled and accelerated MRI. We extract local visual representations to build similarity maps between the registered image pairs at multiple resolution levels and additionally leverage long-range contextual information using a transformer-based module to alleviate ambiguities in the presence of artifacts caused by undersampling. We combine local and global dependencies to perform simultaneous coarse and fine motion estimation. The proposed method was evaluated on in-house acquired fully sampled and accelerated data of 101 patients and 62 healthy subjects undergoing cardiac and thoracic MRI. The impact of motion estimation accuracy on the downstream task of motion-compensated reconstruction was analyzed. We demonstrate that our model derives reliable and consistent motion fields across different sampling trajectories (Cartesian and radial) and acceleration factors of up to 16x for cardiac motion and 30x for respiratory motion and achieves superior image quality in motion-compensated reconstruction qualitatively and quantitatively compared to conventional and recent deep learning-based approaches. The code is publicly available at https://github.com/lab-midas/GMARAFT.


title: Two-Dimensional (2D) Hybrid Method: Expanding 2D Correlation Spectroscopy (2D-COS) for Time Series Analysis

abstract: We present a concise report on the '2DHybrid' method, an innovative extension of two-dimensional correlation spectroscopy (2D COS), tailored for quasar light curve analysis. Addressing the challenge of discerning periodic variations against the background of intrinsic "red" noise fluctuations, this method employs cross-correlation of wavelet transform matrices to reveal distinct correlation patterns between underlaying oscillations, offering new insights into quasar dynamics.


title: Broadband Multi-wavelength Properties of M87 during the 2018 EHT Campaign including a Very High Energy Flaring Episode

abstract: The nearby elliptical galaxy M87 contains one of the only two supermassive black holes whose emission surrounding the event horizon has been imaged by the Event Horizon Telescope (EHT). In 2018, more than two dozen multi-wavelength (MWL) facilities (from radio to gamma-ray energies) took part in the second M87 EHT campaign. The goal of this extensive MWL campaign was to better understand the physics of the accreting black hole M87*, the relationship between the inflow and inner jets, and the high-energy particle acceleration. Understanding the complex astrophysics is also a necessary first step towards performing further tests of general relativity. The MWL campaign took place in April 2018, overlapping with the EHT M87* observations. We present a new, contemporaneous spectral energy distribution (SED) ranging from radio to very high energy (VHE) gamma-rays, as well as details of the individual observations and light curves. We also conduct phenomenological modelling to investigate the basic source properties. We present the first VHE gamma-ray flare from M87 detected since 2010. The flux above 350 GeV has more than doubled within a period of about 36 hours. We find that the X-ray flux is enhanced by about a factor of two compared to 2017, while the radio and millimetre core fluxes are consistent between 2017 and 2018. We detect evidence for a monotonically increasing jet position angle that corresponds to variations in the bright spot of the EHT image. Our results show the value of continued MWL monitoring together with precision imaging for addressing the origins of high-energy particle acceleration. While we cannot currently pinpoint the precise location where such acceleration takes place, the new VHE gamma-ray flare already presents a challenge to simple one-zone leptonic emission model approaches, and emphasises the need for combined image and spectral modelling.


title: Phase transitions, critical behavior and microstructure of the FRW universe in the framework of higher order GUP

abstract: In this paper, we explore the the phase transition, critical behavior and microstructure of the FRW in the framework of a new higher order generalized uncertainty principle. Our initial step involves deriving the equation of state by defining the work density $W$ from GUP-corrected Friedmann equations as the thermodynamic pressure $P$. Based on the modified equation of state, we conduct an analysis of the $P-V$ phase transition in the FRW universe. Subsequently, we obtain the critical exponents and coexistence curves for the small and large phases of the FRW universe around the critical point. Finally, employing Ruppeiner geometry, we derive the thermodynamic curvature scalar $R_N$, investigating its sign-changing curve and spinodal curve. The results reveal distinctive thermodynamic properties for FRW universes with positive and negative GUP parameters $\beta$. In the case of $\beta>0$, the phase transition, critical behavior and microstructure of FRW universe are consistent with those of Van der Waals fluids. Conversely, for $\beta<0$, the results resemble those obtained through effective scalar field theory. These findings underscore the capacity of quantum gravity to induce phase transitions in the universe, warranting further in-depth exploration.


title: Alice's Adventures in a Differentiable Wonderland -- Volume I, A Tour of the Land

abstract: This book is a self-contained introduction to the design of modern (deep) neural networks. Because the term "neural" comes with a lot of historical baggage, I prefer the simpler term "differentiable models" in the text. The focus of this 250-pages volume is on building efficient blocks for processing $n$D data, including convolutions, transformers, graph layers, and modern recurrent models (including linearized transformers and structured state-space models). Because the field is evolving quickly, I have tried to strike a good balance between theory and code, historical considerations and recent trends. I assume the reader has some exposure to machine learning and linear algebra, but I try to cover the preliminaries when necessary. The volume is a refined draft from a set of lecture notes for a course called Neural Networks for Data Science Applications that I teach in Sapienza. I do not cover many advanced topics (generative modeling, explainability, prompting, agents), which will be published over time in the companion website.


title: Using Pre-training and Interaction Modeling for ancestry-specific disease prediction in UK Biobank

abstract: Recent genome-wide association studies (GWAS) have uncovered the genetic basis of complex traits, but show an under-representation of non-European descent individuals, underscoring a critical gap in genetic research. Here, we assess whether we can improve disease prediction across diverse ancestries using multiomic data. We evaluate the performance of Group-LASSO INTERaction-NET (glinternet) and pretrained lasso in disease prediction focusing on diverse ancestries in the UK Biobank. Models were trained on data from White British and other ancestries and validated across a cohort of over 96,000 individuals for 8 diseases. Out of 96 models trained, we report 16 with statistically significant incremental predictive performance in terms of ROC-AUC scores (p-value < 0.05), found for diabetes, arthritis, gall stones, cystitis, asthma and osteoarthritis. For the interaction and pretrained models that outperformed the baseline, the PRS score was the primary driver behind prediction. Our findings indicate that both interaction terms and pre-training can enhance prediction accuracy but for a limited set of diseases and moderate improvements in accuracy


title: Impact of Traffic-Following on Order of Autonomous Airspace Operations

abstract: In this paper, we investigate the dynamic emergence of traffic order in a distributed multi-agent system, aiming to minimize inefficiencies that stem from unnecessary structural impositions. We introduce a methodology for developing a dynamically-updating traffic pattern map of the airspace by leveraging information about the consistency and frequency of flow directions used by current as well as preceding traffic. Informed by this map, an agent can discern the degree to which it is advantageous to follow traffic by trading off utilities such as time and order. We show that for the traffic levels studied, for low degrees of traffic-following behavior, there is minimal penalty in terms of aircraft travel times while improving the overall orderliness of the airspace. On the other hand, heightened traffic-following behavior may result in increased aircraft travel times, while marginally reducing the overall entropy of the airspace. Ultimately, the methods and metrics presented in this paper can be used to optimally and dynamically adjust an agent's traffic-following behavior based on these trade-offs.


title: Sufficiently many projections in archimedean vector lattices with weak order unit

abstract: The property of a vector lattice of sufficiently many projections (SMP) is informed by restricting attention to archimedean $A$ with a distinguished weak order unit $u$ (the class, or category, $\bf{W}$), where the Yosida representation $A \leq D(Y(A,u))$ is available. Here, $A$ SMP is equivalent to $Y(A,u)$ having a $\pi$-base of clopen sets of a certain type called ``local". If the unit is strong, all clopen sets are local and $A$ is SMP if and only if $Y(A,u)$ has clopen $\pi$-base, a property we call $\pi$-zero-dimensional ($\pi$ZD). The paper is in two parts: the first explicates the similarities of SMP and $\pi$ZD; the second consists of examples, including $\pi$ZD but not SMP, and constructions of many SMP's which seem scarce in the literature.


title: A First Look at Spatially Resolved Star Formation at $4.8<z<6.5$ with JWST FRESCO NIRCam Slitless Spectroscopy

abstract: We present the first results on the spatial distribution of star formation in 454 star-forming galaxies at $4.8<z<6.5$ using H-Alpha emission-line maps and F444W imaging tracing the stellar continuum from the JWST FRESCO NIRCam Slitless Spectroscopy Survey. Star-forming galaxies with stellar masses $6.8\leq$log($M_{*}/\mathrm{M}_{\odot}$)$<11.1$ have positive H-Alpha equivalent width profiles, providing direct evidence for the inside-out growth of galaxies just after the epoch of reionisation. GALFIT is used to calculate half-light radii, $R_{\mathrm{eff}}$ and central surface densities within 1 kiloparsec, $\Sigma_{1\mathrm{kpc}}$ of H-Alpha and the continuum. At a fixed stellar mass of log$(M_{*}/\mathrm{M}_{\odot})=9.5$, $\Sigma_{1\mathrm{kpc, H}\alpha}$ is $1.3\pm0.1$ times higher than $\Sigma_{1\mathrm{kpc, C}}$ with consistent H-Alpha and continuum $R_{\mathrm{eff}}$ that are both less than 1 kpc. These measurements suggest the rapid build up of compact bulges without a significant increase in their radii. By comparing to work done at lower redshifts with HST WFC3 Slitless Spectroscopy as part of the 3D-HST ($z=1$) and CLEAR ($z=0.5$) surveys, we find that $R_{\mathrm{eff}}(z)$ and $\Sigma_{1\mathrm{kpc}}(z)$ evolve faster with redshift for H-Alpha. As a function of the Hubble parameter, $\frac{R_{\mathrm{eff, H}\alpha}}{R_{\mathrm{eff, C}}}=1.1h(z)^{-0.1}$ and $\frac{\Sigma_{1\mathrm{kpc,H}\alpha}}{\Sigma _{1\mathrm{kpc,C}}}=h(z)^{0.3}$. These functions indicate there is a transition point at $2<z<4$ where the inside-out growth of the disk starts to dominate over the inside-out growth of the bulge towards lower redshifts. This is supported by the redshift evolution in EW(H$\alpha$) profiles, where there is rapid increase in EW(H$\alpha$) with radius within the half-light radius at $z=5.3$ but only significantly increasing EW(H$\alpha$) with radius in the outer disk at $z=0.5$.


title: Adapting AREPO-RT for Exascale Computing: GPU Acceleration and Efficient Communication

abstract: Radiative transfer (RT) is a crucial ingredient for self-consistent modelling of numerous astrophysical phenomena across cosmic history. However, on-the-fly integration into radiation-hydrodynamics (RHD) simulations is computationally demanding, particularly due to the stringent time-stepping conditions and increased dimensionality inherent in multi-frequency collisionless Boltzmann physics. The emergence of exascale supercomputers, equipped with extensive CPU cores and GPU accelerators, offers new opportunities for enhancing RHD simulations. We present a novel optimization of AREPO-RT explicitly tailored for such high-performance computing environments. We implement a novel node-to-node communication strategy that utilizes shared memory to substitute intra-node communication with direct memory access. Furthermore, combining multiple inter-node messages into a single message substantially enhances network bandwidth utilization and performance for large-scale simulations on modern supercomputers. The single-message node-to-node approach also improves performance on smaller-scale machines with less optimized networks. Furthermore, by transitioning all RT-related calculations to GPUs, we achieve a significant computational speedup of around 15 for standard benchmarks compared to the original CPU implementation. As a case study, we perform cosmological RHD simulations of the Epoch of Reionization, employing a similar setup as the THESAN project. In this context, RT becomes sub-dominant such that even without modifying the core AREPO codebase, there is an overall threefold improvement in efficiency. The advancements presented here have broad implications, potentially transforming the complexity and scalability of future simulations for a wide variety of astrophysical studies.


title: Ultra-high-energy Cosmic Ray Sources can be Gamma-ray Dim

abstract: Ultra-high-energy cosmic rays, accelerated hadrons that can exceed energies of $10^{20}$ eV, are the highest-energy particles ever observed. While the sources producing UHECRs are still unknown, the Pierre Auger Observatory has detected a large-scale dipole anisotropy in the arrival directions of cosmic rays above 8 EeV. In this work, we explore whether resolved gamma-ray sources can reproduce the Auger dipole. We use various Fermi Large Area Telescope catalogs as sources of cosmic rays in CRPropa simulations. We find that in all cases, the simulated dipole has an amplitude significantly larger than that measured by Auger, even when considering large extragalactic magnetic field strengths and optimistic source weighting schemes. Our result implies that the resolved gamma-ray sources are insufficient to account for the population of sources producing the highest-energy cosmic rays, and there must exist a population of UHECR sources that lack gamma-ray emission or are unresolved by the current-generation gamma-ray telescopes.


title: False Vacuum Decay Rate From Thin To Thick Walls

abstract: We consider a single real scalar field in flat spacetime with a polynomial potential up to $\phi^4$, that has a local minimum, the false vacuum, and a deeper global minimum, the true vacuum. When the vacua are almost degenerate we are in the thin wall regime, while as their difference in potential energy increases, we approach the thick wall regime. We give explicit simple formulae for the decay rate of the false vacuum in 3 and 4 spacetime dimensions. Our results include a careful treatment both of the bounce action, which enters at the exponent of the decay rate, and of the functional determinant at one loop, which determines the prefactor. The bounce action is computed analytically as an expansion in the thin wall parameter in generic $D$ dimensions. We find that truncating such an expansion at second order we obtain a remarkably accurate bounce action also deep into thick wall regimes. We calculate the functional determinant numerically in 3 and 4 dimensions and fit the results with simple polynomials of the same thin wall parameter. This allows us to write the complete one-loop decay rate as a compact expression, which works accurately from thin to thick wall regimes.


title: Phonon-driven multipolar dynamics in spin-orbit coupled Mott insulators

abstract: Motivated by ongoing work on pump-probe experiments and Floquet driven magnets, we theoretically study the impact of pumped and driven Einstein phonons with weak dissipation in multipolar Mott insulators. For Mott insulators with pseudospin-$1/2$ non-Kramers doublets hosting octupolar and quadrupolar moments, we show that pumping the ${\cal E}_g$ phonon modes which couple linearly to the quadrupoles leads to characteristic chiral phonon dynamics below the octupolar ordering transition. We also explore steady states in the presence of continuously driven phonons, showing that a coherent two-phonon drive with a suitable phase choice can be used to 'train' octupolar order or even switch its sign. For spin-$1$ magnets, which host dipolar and quadrupolar moments, we show that one-phonon and two-phonon drives can generate Floquet flavor-wave excitations and induce dipolar magnetization. Our results are obtained using a generalized $SU(N)$ Monte Carlo for the multipolar degrees of freedom with numerical integration of the coupled spin-phonon equations of motion. Our work opens up pathways to explore phonon-driven dynamics in multipolar magnets.


title: Disentangling the co-evolution of galaxies and supermassive black holes with PRIMA

abstract: The most active phases of star formation and black hole accretion are strongly affected by dust extinction, making far-infrared (far-IR) observations the best way to disentangle and study the co-evolution of galaxies and super massive black holes. The plethora of fine structure lines and emission features from dust, ionised and neutral atomic and warm molecular gas in the rest-frame mid- and far-IR provide unmatched diagnostic power to determine the properties of gas and dust, measure gas-phase metallicities and map cold galactic outflows in even the most obscured galaxies. By combining multi-band photometric surveys with low and high-resolution far-IR spectroscopy, the PRobe far-Infrared Mission for Astrophysics (PRIMA), a concept for a far-IR, 1.8m-diameter, cryogenically cooled observatory, will revolutionise the field of galaxy evolution by taking advantage of this IR toolkit to find and study dusty galaxies across galactic time. In this work, we make use of the phenomenological simulation SPRITZ and the Santa Cruz semi-analytical model to describe how a moderately deep multi-band PRIMA photometric survey can easily reach beyond previous IR missions to detect and study galaxies down to $10^{11}\,L_{\odot}$ beyond cosmic noon and at least up to z=4, even in the absence of gravitational lensing. By decomposing the spectral energy distribution (SED) of these photometrically selected galaxies, we show that PRIMA can be used to accurately measure the relative AGN power, the mass fraction contributed by polycyclic aromatic hydrocarbon (PAH) and the total IR luminosity. At the same time, spectroscopic follow up with PRIMA will allow to trace both the star formation and black hole accretion rates (SFR, BHAR), the gas phase metallicities and the mass outflow rates of cold gas in hundreds to thousands of individual galaxies to z=2.


title: Charge density-waves with non-trivial orbital textures in rare earth tritellurides

abstract: Motivated by recent experiments reporting unconventional collective modes in the charge density-wave (CDW) state of rare-earth tritellurides $R$Te$_3$, we derive from a multi-orbital microscopic model on the square net a CDW Ginzburg-Landau theory that allows for non-trivial orbital order. Our analysis reveals unconventional CDWs where order parameters with distinct orbital character coexist due to an approximate symmetry of the low-energy model, which becomes exact in the limit of nearest-neighbor-only hopping and decoupled $p_x$, $p_y$ orbitals. Because of this coexistence, the resulting CDW pattern displays an orbital texture that generally breaks additional symmetries of the lattice besides those explicitly broken by the CDW wave-vector. In particular, we find two competing phases that differ in whether they break or preserve inversion and vertical mirror symmetries. We explain the mechanisms that favor each outcome, and discuss experimental probes that can distinguish the different phases.


title: Lorentz violating backgrounds from quadratic, shift-symmetric, ultralight dark matter

abstract: We consider an effective theory for a shift-symmetric, quadratically-coupled, ultralight spin-0 field. The leading CP-conserving interactions with Standard Model fields in the effective theory arise at dimension 8. We discuss the renormalization group evolution and positivity bounds on these operators, as well as their possible UV origins. Assuming that the spin-0 field is associated with an ultralight dark matter candidate, we discuss the effects of the dimension-8 operators on experiments searching for the oscillation of fundamental constants and Lorentz violation. We find that the direct bounds on these two effects are of similar strength but rather weak, corresponding to a UV cutoff scale of keV order, as they are mediated by dimension-8 operators.


title: The NuSTAR Serendipitous Survey: the 80-month catalog and source properties of the high-energy emitting AGN and quasar population

abstract: We present a catalog of hard X-ray serendipitous sources detected in the first 80 months of observations by the Nuclear Spectroscopic Telescope Array (NuSTAR). The NuSTAR serendipitous survey 80-month (NSS80) catalog has an unprecedented $\sim$ 62 Ms of effective exposure time over 894 unique fields (a factor of three increase over the 40-month catalog), with an areal coverage of $\sim $36 deg$^2$, larger than all NuSTAR extragalactic surveys. NSS80 provides 1274 hard X-ray sources in the $3-24$ keV band (822 new detections compared to the previous 40-month catalog). Approximately 76% of the NuSTAR sources have lower-energy ($<10$ keV) X-ray counterparts from Chandra, XMM-Newton, and Swift-XRT. We have undertaken an extensive campaign of ground-based spectroscopic follow-up to obtain new source redshifts and classifications for 427 sources. Combining these with existing archival spectroscopy provides redshifts for 550 NSS80 sources, of which 547 are classified. The sample is primarily composed of active galactic nuclei (AGN), detected over a large range in redshift ($z$ = 0.012-3.43), but also includes 58 spectroscopically confirmed Galactic sources. In addition, five AGN/galaxy pairs, one dual AGN system, one BL Lac candidate, and a hotspot of 4C 74.26 (radio quasar) have been identified. The median rest-frame $10-40$ keV luminosity and redshift of the NSS80 are $\langle{L_\mathrm{10-40 keV}}\rangle$ = 1.2 $\times$ 10$^{44}$ erg s$^{-1}$ and $\langle z \rangle = 0.56$. We investigate the optical properties and construct composite optical spectra to search for subtle signatures not present in the individual spectra, finding an excess of redder BL AGN compared to optical quasar surveys predominantly due to the presence of the host-galaxy and, at least in part, due to dust obscuration.


title: A self-consistent Hartree theory for lattice-relaxed magic-angle twisted bilayer graphene

abstract: For twisted bilayer graphene close to magic angle, we show that the effects of lattice relaxation and the Hartree interaction both become simultaneously important. Including both effects in a continuum theory reveals a Lifshitz transition to a Fermi surface topology that supports both a ``heavy fermion" pocket and an ultraflat band ($\approx 8~{\rm meV}$) that is pinned to the Fermi energy for a large range of fillings. We provide analytical and numerical results to understand the narrow ``magic angle range" that supports this pinned ultraflat band and make predictions for its experimental observation. We believe that the bands presented here are accurate at high temperature and provide a good starting point to understand the myriad of complex behaviour observed in this system.


title: Generalized Symmetries of Non-Supersymmetric Orbifolds

abstract: We determine generalized symmetries for 4D theories engineered via type II strings on non-supersymmetric orbifold backgrounds $\mathbb{R}^{3,1} \times \mathbb{R}^6 / \Gamma$. Probe branes detect generalized symmetries via the adjacency matrix for fermionic degrees of freedom in an associated quiver gauge theory. In situations where the tachyons are sequestered away from the boundary $S^5 / \Gamma$, this exactly matches the result extracted from singular homology. In situations with an unsequestered tachyon which stretches out to the boundary, the presence of tachyonic pulses partitions up the space into several distinct sectors, and the net contribution again matches with the answer expected via quiver methods. For IIA backgrounds, the presence of a localized closed string tachyon leads to transitions in the spectrum of states, generalized symmetries, higher-group symmetries, as well as the level matrix of the associated symmetry topological field theory (SymTFT). For IIB backgrounds with a stack of spacetime filling probe D3-branes, the onset of a radiatively generated potential leads to similar considerations involving scale dependent transitions in the symmetries of the theory, including structures such as duality defects / interfaces.


title: Separating Dark Acoustic Oscillations from Astrophysics at Cosmic Dawn

abstract: The formation redshift and abundance of the first stars and galaxies is highly sensitive to the build up of low mass dark matter halos as well as astrophysical feedback effects which modulate star formation in these low mass halos. The 21-cm signal at cosmic dawn will depend strongly on the formation of these first luminous sources and thus can be used to constrain unknown astrophysical and dark matter properties in the early universe. In this paper, we explore how well we could measure properties of dark matter using the 21-cm power spectrum at $z>10$, given unconstrained astrophysical parameters. We create a generalizable form of the dark matter halo mass function for models with damped and/or oscillatory linear power spectra, finding a single "smooth-k" window function which describes a broad range of models including CDM. We use this to make forecasts for structure formation using the Effective Theory of Structure Formation (ETHOS) framework to explore a broad parameter space of dark matter models. We make predictions for the 21-cm power spectrum observed by HERA varying both cosmological ETHOS parameters as well as astrophysical parameters. Using a Markov Chain Monte Carlo forecast we find that the ETHOS dark matter parameters are degenerate with astrophysical parameters linked to star formation in low mass dark matter halos but not with X-ray heating produced by the first generation of stars. After marginalizing over uncertainties in astrophysical parameters we demonstrate that with just 540 days of HERA observations it should be possible to distinguish between CDM and a broad range of dark matter models with suppression at wavenumbers $k\lesssim 200\,h$Mpc$^{-1}$ assuming a moderate noise level. These results demonstrate the potential of 21-cm observations to constrain the matter power spectrum on scales smaller than current probes.


title: Patterns of active dipolar particles in external magnetic fields

abstract: Active particles with a (magnetic) dipole moment are of interest for steering self-propelled motion, but also result in novel collective effects due to their dipole-dipole interaction. Here systems of active dipolar particles are studied with Brownian dynamics simulations to systematically characterize the different patterns they form, specifically in the presence of an external (magnetic) field. The combination of three types of order - clustering, orientational alignment and chain formation - is used to classify the patterns observed in these systems. In the presence of an external field, oriented chains and bands are found to be dominant. These structures show some similarities with columnar cluster seen in (passive) ferrofluids and display columnar spacing and number of lanes per cluster that both decrease with increasing field strength.


title: Empowering Large Language Models for Textual Data Augmentation

abstract: With the capabilities of understanding and executing natural language instructions, Large language models (LLMs) can potentially act as a powerful tool for textual data augmentation. However, the quality of augmented data depends heavily on the augmentation instructions provided, and the effectiveness can fluctuate across different downstream tasks. While manually crafting and selecting instructions can offer some improvement, this approach faces scalability and consistency issues in practice due to the diversity of downstream tasks. In this work, we address these limitations by proposing a new solution, which can automatically generate a large pool of augmentation instructions and select the most suitable task-informed instructions, thereby empowering LLMs to create high-quality augmented data for different downstream tasks. Empirically, the proposed approach consistently generates augmented data with better quality compared to non-LLM and LLM-based data augmentation methods, leading to the best performance on 26 few-shot learning tasks sourced from a wide range of application domains.


title: Simultaneous measurement of extensional stress and flow birefringence field for uniaxially extending worm-like micellar solutions

abstract: The present study proposes a novel and simple rheo-optical technique to investigate the relation between the rheology of complex fluids and their internal structural deformation under uniaxial extensional flow. The macroscale results of viscoelasticity from rheological measurements and microscale results of birefringence from optical measurements are combined to evaluate the microstructural deformation and orientation state inside the fluids under extensional stress. The proposed technique combines a liquid dripping method with a high-speed polarization camera to measure the extensional stress and flow-induced birefringence field simultaneously. In the liquid dripping method, temporal evolution images of the liquid filament diameter for fluids dripping from a nozzle are measured to obtain the extensional stress loading on the liquid filament. These images are captured with a high-speed polarization camera connected to a micro polarization element alley, enabling high-speed imaging of the birefringent field. Worm-like micellar solutions of cetyltrimethylammonium bromide (CTAB) and sodium salicylate (NaSal) with varying concentrations of CTAB and NaSal are employed as the measurement targets. Consequently, we successfully visualized temporally developing images of the birefringence field of uniaxially extending worm-like micellar solutions induced by the orientation of micelles toward the extensional direction. Furthermore, the proposed technique supports investigating the conditions for establishing the stress-optical rule, which is the linear relation between stress and birefringence for complex fluids. The stress-optical coefficient, a proportionality constant indicating the sensitivity of birefringence to stress, is analyzed from these measurements. The stress-optical coefficient under uniaxial extensional flow is confirmed to be comparable to that under shear flow.