title: Towards Robust and Accurate Visual Prompting

abstract: Visual prompting, an efficient method for transfer learning, has shown its potential in vision tasks. However, previous works focus exclusively on VP from standard source models, it is still unknown how it performs under the scenario of a robust source model: Whether a visual prompt derived from a robust model can inherit the robustness while suffering from the generalization performance decline, albeit for a downstream dataset that is different from the source dataset? In this work, we get an affirmative answer of the above question and give an explanation on the visual representation level. Moreover, we introduce a novel technique named Prompt Boundary Loose (PBL) to effectively mitigates the suboptimal results of visual prompt on standard accuracy without losing (or even significantly improving) its adversarial robustness when using a robust model as source model. Extensive experiments across various datasets show that our findings are universal and demonstrate the significant benefits of our proposed method.


title: Multiplex Visibility Graphs as a complementary tool for describing the relation between ground level O3 and NO2

abstract: The usage of multilayer complex networks for the analysis of correlations among environmental variables (such as O3 and NO2 concentrations from the photochemical smog) is investigated in this work. The mentioned technique is called Multiplex Visibility Graphs (MVG). By performing the joint analysis of those layers, the parameters named Average Edge Overlap and Interlayer Mutual Information are extracted, which accounts for the microscopical time coherence and the correlation between the time series behavior, respectively. These parameters point to the possibility of using them independently to describe the correlation between atmospheric pollutants (which could be extended to environmental time series). More precisely the first one of them is considered to be a potential new approach to determine the time required for the correlation of NO2 and O3 to be observed, since it is obtained from the correlation of the pollutants at the smallest time scale. As for the second one, it has been checked that the proposed technique can be used to describe the variation of the correlation between the two gases along the seasons. In short, MVGs parameters are introduced and results show that they could be potentially used in a future for correlation studies, supplementing already existing techniques.


title: Normalized ground states for a coupled Schr\"odinger system: Mass super-critical case

abstract: We consider the existence of solutions $(\lambda_1,\lambda_2, u, v)\in \mathbb{R}^2\times (H^1(\mathbb{R}^N))^2$ to systems of coupled Schr\"odinger equations $$ \begin{cases} -\Delta u+\lambda_1 u=\mu_1 u^{p-1}+\beta r_1 u^{r_1-1}v^{r_2}\quad &\hbox{in}~\mathbb{R}^N,\\ -\Delta v+\lambda_2 v=\mu_2 v^{q-1}+\beta r_2 u^{r_1}v^{r_2-1}\quad &\hbox{in}~\mathbb{R}^N,\\ 0<u,v\in H^1(\mathbb{R}^N), \, 1\leq N\leq 4,& \end{cases} $$ satisfying the normalization $$ \int_{\mathbb{R}^N}u^2 \mathrm{d}x=a \quad \mbox{and} \quad \int_{\mathbb{R}^N}v^2 \mathrm{d}x=b.$$ Here $\mu_1,\mu_2,\beta>0$ and the prescribed masses $a,b>0$. We focus on the coupled purely mass super-critical case, i.e., $$2+\frac{4}{N}<p,q,r_1+r_2<2^*$$ with $2^*$ being the Sobolev critical exponent, defined by $2^*:=+\infty$ for $N=1,2$ and $2^*:=\frac{2N}{N-2}$ for $N=3,4$. We optimize the range of $(a,b,\beta,r_1,r_2)$ for the existence. In particular, for $N=3,4$ with $r_1,r_2\in (1,2)$, our result indicates the existence for all $a,b>0$ and $\beta>0$.


title: Behavior Optimized Image Generation

abstract: The last few years have witnessed great success on image generation, which has crossed the acceptance thresholds of aesthetics, making it directly applicable to personal and commercial applications. However, images, especially in marketing and advertising applications, are often created as a means to an end as opposed to just aesthetic concerns. The goal can be increasing sales, getting more clicks, likes, or image sales (in the case of stock businesses). Therefore, the generated images need to perform well on these key performance indicators (KPIs), in addition to being aesthetically good. In this paper, we make the first endeavor to answer the question of "How can one infuse the knowledge of the end-goal within the image generation process itself to create not just better-looking images but also "better-performing'' images?''. We propose BoigLLM, an LLM that understands both image content and user behavior. BoigLLM knows how an image should look to get a certain required KPI. We show that BoigLLM outperforms 13x larger models such as GPT-3.5 and GPT-4 in this task, demonstrating that while these state-of-the-art models can understand images, they lack information on how these images perform in the real world. To generate actual pixels of behavior-conditioned images, we train a diffusion-based model (BoigSD) to align with a proposed BoigLLM-defined reward. We show the performance of the overall pipeline on two datasets covering two different behaviors: a stock dataset with the number of forward actions as the KPI and a dataset containing tweets with the total likes as the KPI, denoted as BoigBench. To advance research in the direction of utility-driven image generation and understanding, we release BoigBench, a benchmark dataset containing 168 million enterprise tweets with their media, brand account names, time of post, and total likes.


title: BrainZ-BP: A Non-invasive Cuff-less Blood Pressure Estimation Approach Leveraging Brain Bio-impedance and Electrocardiogram

abstract: Accurate and continuous blood pressure (BP) monitoring is essential to the early prevention of cardiovascular diseases. Non-invasive and cuff-less BP estimation algorithm has gained much attention in recent years. Previous studies have demonstrated that brain bio-impedance (BIOZ) is a promising technique for non-invasive intracranial pressure (ICP) monitoring. Clinically, treatment for patients with traumatic brain injuries (TBI) requires monitoring the ICP and BP of patients simultaneously. Estimating BP by brain BIOZ directly can reduce the number of sensors attached to the patients, thus improving their comfort. To address the issues, in this study, we explore the feasibility of leveraging brain BIOZ for BP estimation and propose a novel cuff-less BP estimation approach called BrainZ-BP. Two electrodes are placed on the forehead and occipital bone of the head in the anterior-posterior direction for brain BIOZ measurement. Various features including pulse transit time and morphological features of brain BIOZ are extracted and fed into four regression models for BP estimation. Results show that the mean absolute error, root mean square error, and correlation coefficient of random forest regression model are 2.17 mmHg, 3.91 mmHg, and 0.90 for systolic pressure estimation, and are 1.71 mmHg, 3.02 mmHg, and 0.89 for diastolic pressure estimation. The presented BrainZ-BP can be applied in the brain BIOZ-based ICP monitoring scenario to monitor BP simultaneously.


title: Assessment of Pressure Based Solver in Resolving Complex Shock Wave Phenomenon

abstract: This study presents a critical assessment of a pressure-based solver (PBS) in resolving complex interactions of shocks, turbulent structures etc.. The canonical problem chosen to be resolved in this study is of mode staging in axisymmetric supersonic jet screech. The screech phenomenon exhibits staging behavior characterized by frequency and azimuthal structure changes at specific frequencies. The PBS simulations in the popular ANSYS Fluent software-suite were validated against numerical work and experimental measurements, and results were analyzed. Simulations are performed on supersonic jets which emits dual high frequency screech tones at particular Mach numbers. At lower end of these supersonic Mach numbers, the flow can involve vanishingly weak shock strengths which is routinely captured in experiments and by density based solvers in literature. The limitations of the pressure-based solver in resolving complex shock flow phenomena and predicting mode staging are highlighted at vanishingly weak Mach numbers, emphasizing the need for further investigation given the recent popularity of such solvers for all Mach numbers including in high-speed flow.


title: Learning Scene Context Without Images

abstract: Teaching machines of scene contextual knowledge would enable them to interact more effectively with the environment and to anticipate or predict objects that may not be immediately apparent in their perceptual field. In this paper, we introduce a novel transformer-based approach called $LMOD$ ( Label-based Missing Object Detection) to teach scene contextual knowledge to machines using an attention mechanism. A distinctive aspect of the proposed approach is its reliance solely on labels from image datasets to teach scene context, entirely eliminating the need for the actual image itself. We show how scene-wide relationships among different objects can be learned using a self-attention mechanism. We further show that the contextual knowledge gained from label based learning can enhance performance of other visual based object detection algorithm.


title: HL-LHC sensitivity to higgsinos from natural SUSY with gravitino LSP

abstract: In the realm of natural supersymmetric models, higgsinos are typically the lightest electroweakinos. In gauge-mediated supersymmetry breaking models, the lightest higgsino-dominated particles decay into a $Z$-boson or a Higgs boson ($h$), along with an ultra-light gravitino ($\tilde{G}$) serving as the lightest supersymmetric particle (LSP). This scenario suggests a significant non-resonant $hh$ production. Basing on the recent global fitting results of the $\tilde{G}$-EWMSSM (MSSM with light electroweakinos and an eV-scale gravitino as the LSP) performed by the \textsf{GAMBIT} collaboration, which support a higgsino-dominated electroweakino as light as 140 GeV, we develop two simplified models to evaluate their detection potential at the high-luminosity LHC (HL-LHC) with $\sqrt{s} = 14~{\rm TeV}$ and an integrated luminosity of $3000~{\rm fb}^{-1}$. The first model examines the processes where heavier higgsino-dominated states decay into soft $W/Z$ bosons, while the second focuses on direct decays of all three higgsino-dominated electroweakinos into $W/Z/h$ plus a $\tilde{G}$. Our study, incorporating both models and their distinct decay channels, utilizes detailed Monte Carlo simulations for signals and standard model backgrounds. We find that the HL-LHC can probe higgsinos up to above 500 GeV, potentially discovering or excluding the natural SUSY scenario in the context of a gravitino LSP. Further, we reinterpret this discovery potential using the GAMBIT global fit samples, and find that the entire parameter space of $|\mu| \leq 500~{\rm GeV}$ with an electroweak fine-tuning measure ($\Delta_{\rm EW}$) under 100 in $\tilde{G}$-EWMSSM is accessible at the HL-LHC.


title: Comparison of CMS measurements with predictions at NLO applying the Parton Branching Method and PYTHIA

abstract: In August 2023, more than 30 students joined the Special Remote DESY summer-school to work on projects of importance for LHC experiments. In a dedicated initiative, analyses that had not been incorporated into the RIVET package were implemented and verified. Here, a brief description of the accomplished work is given, and a comparison of the measurements with predictions obtained from matched standard parton shower Monte Carlo event generators as well as with those obtained from Parton-Branching TMDs with corresponding parton showers are presented.


title: Gendec: A Machine Learning-based Framework for Gender Detection from Japanese Names

abstract: Every human has their own name, a fundamental aspect of their identity and cultural heritage. The name often conveys a wealth of information, including details about an individual's background, ethnicity, and, especially, their gender. By detecting gender through the analysis of names, researchers can unlock valuable insights into linguistic patterns and cultural norms, which can be applied to practical applications. Hence, this work presents a novel dataset for Japanese name gender detection comprising 64,139 full names in romaji, hiragana, and kanji forms, along with their biological genders. Moreover, we propose Gendec, a framework for gender detection from Japanese names that leverages diverse approaches, including traditional machine learning techniques or cutting-edge transfer learning models, to predict the gender associated with Japanese names accurately. Through a thorough investigation, the proposed framework is expected to be effective and serve potential applications in various domains.


title: Density profile of a self-gravitating polytropic turbulent fluid in a rotating disk near to the cloud core

abstract: We obtain two equations (following from two different approaches) for the density profile in a self-gravitating polytropic cylindrically symmetric and rotating turbulent gas disk. The adopted physical picture is appropriate to describe the conditions near to the cloud core where the equation of state of the gas changes from isothermal (in the outer cloud layers) to one of "hard polytrope", and the symmetry changes from spherical to cylindrical. On the assumption of steady state, as the accreting matter passes through all spatial scales, we show that the total energy per unit mass is an invariant with respect to the fluid flow. The obtained equation describes the balance of the kinetic, thermal and gravitational energy of a fluid element. We also introduce a method for approximating density profile solutions (in a power-law form), leading to the emergence of three different regimes. We apply, as well, dynamical analysis of the motion of a fluid element. Only one of the regimes is in accordance with the two approaches (energy and force balance). It corresponds to a density profile of a slope -2, polytropic exponent 3/2, and sub-Keplerian rotation of the disk, when the gravity is balanced by the thermal pressure. It also matches with some observations and numerical works and, in particular, leads to a second power-law tail (of a slope approx. -1) of the density distribution function in dense, self-gravitating cloud regions.


title: Wasserstein Convergence Guarantees for a General Class of Score-Based Generative Models

abstract: Score-based generative models (SGMs) is a recent class of deep generative models with state-of-the-art performance in many applications. In this paper, we establish convergence guarantees for a general class of SGMs in 2-Wasserstein distance, assuming accurate score estimates and smooth log-concave data distribution. We specialize our result to several concrete SGMs with specific choices of forward processes modelled by stochastic differential equations, and obtain an upper bound on the iteration complexity for each model, which demonstrates the impacts of different choices of the forward processes. We also provide a lower bound when the data distribution is Gaussian. Numerically, we experiment SGMs with different forward processes, some of which are newly proposed in this paper, for unconditional image generation on CIFAR-10. We find that the experimental results are in good agreement with our theoretical predictions on the iteration complexity, and the models with our newly proposed forward processes can outperform existing models.


title: A Foundation Model for Cell Segmentation

abstract: Cells are the fundamental unit of biological organization, and identifying them in imaging data - cell segmentation - is a critical task for various cellular imaging experiments. While deep learning methods have led to substantial progress on this problem, models that have seen wide use are specialist models that work well for specific domains. Methods that have learned the general notion of "what is a cell" and can identify them across different domains of cellular imaging data have proven elusive. In this work, we present CellSAM, a foundation model for cell segmentation that generalizes across diverse cellular imaging data. CellSAM builds on top of the Segment Anything Model (SAM) by developing a prompt engineering approach to mask generation. We train an object detector, CellFinder, to automatically detect cells and prompt SAM to generate segmentations. We show that this approach allows a single model to achieve state-of-the-art performance for segmenting images of mammalian cells (in tissues and cell culture), yeast, and bacteria collected with various imaging modalities. To enable accessibility, we integrate CellSAM into DeepCell Label to further accelerate human-in-the-loop labeling strategies for cellular imaging data. A deployed version of CellSAM is available at https://label-dev.deepcell.org/.


title: Rainbow and Gallai-Rado numbers involving binary function equations

abstract: Let $\mathcal{E}$, $\mathcal{E}_1$, and $\mathcal{E}_2$ be equations, $n$ and $k$ be positive integers. The rainbow number $\operatorname{rb}([n],\mathcal{E})$ is difined as the minimum number of colors such that for every exact $(\operatorname{rb}([n],\mathcal{E}))$-coloring of $[n]$, there exists a rainbow solution of $\mathcal{E}$. The Gallai-Rado number $\operatorname{GR}_k(\mathcal{E}_1:\mathcal{E}_2)$ is defined as the minimum positive integer $N$, if it exists, such that for all $n\ge N$, every $k$-colored $[n]$ contains either a rainbow solution of $\mathcal{E}_1$ or a monochromatic solution of $\mathcal{E}_2$. In this paper, we get some exact values of rainbow and Gallai-Rado numbers involving binary function equations. We also provide an algorithm to calculate the rainbow numbers of nonlinear binary function equations.


title: Is there a finite mobility for the one vibrational mode Holstein model? Implications from real time simulations

abstract: The question of whether there exists a finite mobility in the standard Holstein model with one vibrational mode on each site remains unclear. In this letter, we approach this problem by employing the hierarchical equation of motion (HEOM) method to simulate model systems where the vibrational modes are dissipative. It is found that, as the friction becomes smaller, the charge carrier mobility increases significantly and a friction free limit can not be obtained. The current autocorrelation functions are also calculated for the friction free Holstein model, and converged results can not be obtained with the increase of the number of sites. Based on these observations, we conclude that a finite mobility can not be defined for the standard Holstein model, which is consistent with the recent finding by Kolss {\it et al.} (Phys. Rev. Lett. 123, 126601).


title: Constraint-aware Policy for Compliant Manipulation

abstract: Robot manipulation in a physically-constrained environment requires compliant manipulation. Compliant manipulation is a manipulation skill to adjust hand motion based on the force imposed by the environment. Recently, reinforcement learning (RL) has been applied to solve household operations involving compliant manipulation. However, previous RL methods have primarily focused on designing a policy for a specific operation that limits their applicability and requires separate training for every new operation. We propose a constraint-aware policy that is applicable to various unseen manipulations by grouping several manipulations together based on the type of physical constraint involved. The type of physical constraint determines the characteristic of the imposed force direction; thus, a generalized policy is trained in the environment and reward designed on the basis of this characteristic. This paper focuses on two types of physical constraints: prismatic and revolute joints. Experiments demonstrated that the same policy could successfully execute various compliant-manipulation operations, both in the simulation and reality. We believe this study is the first step toward realizing a generalized household-robot.


title: Nonexistence results for a semilinear heat equation with Hardy potential on stratified Lie groups

abstract: A simple explanation is provided to explain why weighted blow up is observed for weak solutions of certain semilinear heat equations with Hardy potential. The problem we study has a power non-linearity and a forcing term which depends only upon the space variable. Local and global nonexistence results are provided for this problem. In addition, local existence is proved when the gradient term appearing in the Hardy potential is unimodular almost everywhere. Under additional assumption that the forcing term depends on time as well, global existence is also proved. Through these existence results we predict the critical exponents for the existence of local and global solutions.


title: Joyful: Joint Modality Fusion and Graph Contrastive Learning for Multimodal Emotion Recognition

abstract: Multimodal emotion recognition aims to recognize emotions for each utterance of multiple modalities, which has received increasing attention for its application in human-machine interaction. Current graph-based methods fail to simultaneously depict global contextual features and local diverse uni-modal features in a dialogue. Furthermore, with the number of graph layers increasing, they easily fall into over-smoothing. In this paper, we propose a method for joint modality fusion and graph contrastive learning for multimodal emotion recognition (Joyful), where multimodality fusion, contrastive learning, and emotion recognition are jointly optimized. Specifically, we first design a new multimodal fusion mechanism that can provide deep interaction and fusion between the global contextual and uni-modal specific features. Then, we introduce a graph contrastive learning framework with inter-view and intra-view contrastive losses to learn more distinguishable representations for samples with different sentiments. Extensive experiments on three benchmark datasets indicate that Joyful achieved state-of-the-art (SOTA) performance compared to all baselines.


title: Full Waveform Inversion and Lagrange Multipliers

abstract: Full-waveform inversion (FWI) is an effective method for imaging subsurface properties using sparsely recorded data. It involves solving a wave propagation problem to estimate model parameters that accurately reproduce the data. Recent trends in FWI have led to the development of extended methodologies, among which source extension methods leveraging reconstructed wavefields to solve penalty or augmented Lagrangian (AL) formulations have emerged as robust algorithms, even for inaccurate initial models. Despite their demonstrated robustness, challenges remain, such as the lack of a clear physical interpretation, difficulty in comparison, and reliance on difficult-to-compute least squares (LS) wavefields. This paper is divided into two critical parts. In the first, a novel formulation of these methods is explored within a unified Lagrangian framework. This novel perspective permits the introduction of alternative algorithms that employ LS multipliers instead of wavefields. These multiplier-oriented variants appear as regularizations of the standard FWI, are adaptable to the time domain, offer tangible physical interpretations, and foster enhanced convergence efficiency. The second part of the paper delves into understanding the underlying mechanisms of these techniques. This is achieved by solving the FWI equations using iterative linearization and inverse scattering methods. The paper provides insight into the role and significance of Lagrange multipliers in enhancing the linearization of FWI equations. It explains how different methods estimate multipliers or make approximations to increase computing efficiency. Additionally, it presents a new physical understanding of the Lagrange multiplier used in the AL method, highlighting how important it is for improving algorithm performance when compared to penalty methods.


title: PAIReD jet: A multi-pronged resonance tagging strategy across all Lorentz boosts

abstract: We propose a new approach of jet-based event reconstruction that aims to optimally exploit correlations between the products of a hadronic multi-pronged decay across all Lorentz boost regimes. The new approach utilizes clustered small-radius jets as seeds to define unconventional jets, referred to as PAIReD jets. The constituents of these jets are subsequently used as inputs to machine learning-based algorithms to identify the flavor content of the jet. We demonstrate that this approach achieves higher efficiencies in the reconstruction of signal events containing heavy-flavor jets compared to other event reconstruction strategies at all Lorentz boost regimes. Classifiers trained on PAIReD jets also have significantly better background rejections compared to those based on traditional event reconstruction approaches using small-radius jets at low Lorentz boost regimes. The combined effect of a higher signal reconstruction efficiency and better classification performance results in a two to four times stronger rejection of light-flavor jets compared to conventional strategies at low Lorentz-boosts, and rejection rates similar to classifiers based on large-radius multi-pronged jets at high Lorentz-boost regimes.


title: Bit Cipher -- A Simple yet Powerful Word Representation System that Integrates Efficiently with Language Models

abstract: While Large Language Models (LLMs) become ever more dominant, classic pre-trained word embeddings sustain their relevance through computational efficiency and nuanced linguistic interpretation. Drawing from recent studies demonstrating that the convergence of GloVe and word2vec optimizations all tend towards log-co-occurrence matrix variants, we construct a novel word representation system called Bit-cipher that eliminates the need of backpropagation while leveraging contextual information and hyper-efficient dimensionality reduction techniques based on unigram frequency, providing strong interpretability, alongside efficiency. We use the bit-cipher algorithm to train word vectors via a two-step process that critically relies on a hyperparameter -- bits -- that controls the vector dimension. While the first step trains the bit-cipher, the second utilizes it under two different aggregation modes -- summation or concatenation -- to produce contextually rich representations from word co-occurrences. We extend our investigation into bit-cipher's efficacy, performing probing experiments on part-of-speech (POS) tagging and named entity recognition (NER) to assess its competitiveness with classic embeddings like word2vec and GloVe. Additionally, we explore its applicability in LM training and fine-tuning. By replacing embedding layers with cipher embeddings, our experiments illustrate the notable efficiency of cipher in accelerating the training process and attaining better optima compared to conventional training paradigms. Experiments on the integration of bit-cipher embedding layers with Roberta, T5, and OPT, prior to or as a substitute for fine-tuning, showcase a promising enhancement to transfer learning, allowing rapid model convergence while preserving competitive performance.


title: Implicit Event-RGBD Neural SLAM

abstract: Implicit neural SLAM has achieved remarkable progress recently. Nevertheless, existing methods face significant challenges in non-ideal scenarios, such as motion blur or lighting variation, which often leads to issues like convergence failures, localization drifts, and distorted mapping. To address these challenges, we propose EN-SLAM, the first event-RGBD implicit neural SLAM framework, which effectively leverages the high rate and high dynamic range advantages of event data for tracking and mapping. Specifically, EN-SLAM proposes a differentiable CRF (Camera Response Function) rendering technique to generate distinct RGB and event camera data via a shared radiance field, which is optimized by learning a unified implicit representation with the captured event and RGBD supervision. Moreover, based on the temporal difference property of events, we propose a temporal aggregating optimization strategy for the event joint tracking and global bundle adjustment, capitalizing on the consecutive difference constraints of events, significantly enhancing tracking accuracy and robustness. Finally, we construct the simulated dataset DEV-Indoors and real captured dataset DEV-Reals containing 6 scenes, 17 sequences with practical motion blur and lighting changes for evaluations. Experimental results show that our method outperforms the SOTA methods in both tracking ATE and mapping ACC with a real-time 17 FPS in various challenging environments. Project page: https://delinqu.github.io/EN-SLAM.


title: Lesion Search with Self-supervised Learning

abstract: Content-based image retrieval (CBIR) with self-supervised learning (SSL) accelerates clinicians' interpretation of similar images without manual annotations. We develop a CBIR from the contrastive learning SimCLR and incorporate a generalized-mean (GeM) pooling followed by L2 normalization to classify lesion types and retrieve similar images before clinicians' analysis. Results have shown improved performance. We additionally build an open-source application for image analysis and retrieval. The application is easy to integrate, relieving manual efforts and suggesting the potential to support clinicians' everyday activities.


title: Power Aware Scheduling of Tasks on FPGAs in Data Centers

abstract: A variety of computing platform like Field Programmable Gate Array (FPGA), Graphics Processing Unit (GPU) and multicore Central Processing Unit (CPU) in data centers are suitable for acceleration of data-intensive workloads. Especially, FPGA platforms in data centers are gaining popularity for high-performance computations due to their high speed, reconfigurable nature and cost effectiveness. Such heterogeneous, highly parallel computational architectures in data centers, combined with high-speed communication technologies like 5G, are becoming increasingly suitable for real-time applications. However, flexibility, cost-effectiveness, high computational capabilities, and energy efficiency remain challenging issues in FPGA based data centers. In this context an energy efficient scheduling solution is required to maximize the resource profitability of FPGA. This paper introduces a power-aware scheduling methodology aimed at accommodating periodic hardware tasks within the available FPGAs of a data center at their potentially maximum speed. This proposed methodology guarantees the execution of these tasks us ing the maximum number of parallel computation units possible to implement in the FPGAs, with minimum power consumption. The proposed scheduling methodology is implemented in a data center with multiple Alveo-50 Xilinx-AMD FPGAs and Vitis 2023 tool. The evidence from the implementation shows the proposed scheduling methodology is efficient compared to existing solutions.


title: SNI-SLAM: Semantic Neural Implicit SLAM

abstract: We propose SNI-SLAM, a semantic SLAM system utilizing neural implicit representation, that simultaneously performs accurate semantic mapping, high-quality surface reconstruction, and robust camera tracking. In this system, we introduce hierarchical semantic representation to allow multi-level semantic comprehension for top-down structured semantic mapping of the scene. In addition, to fully utilize the correlation between multiple attributes of the environment, we integrate appearance, geometry and semantic features through cross-attention for feature collaboration. This strategy enables a more multifaceted understanding of the environment, thereby allowing SNI-SLAM to remain robust even when single attribute is defective. Then, we design an internal fusion-based decoder to obtain semantic, RGB, Truncated Signed Distance Field (TSDF) values from multi-level features for accurate decoding. Furthermore, we propose a feature loss to update the scene representation at the feature level. Compared with low-level losses such as RGB loss and depth loss, our feature loss is capable of guiding the network optimization on a higher-level. Our SNI-SLAM method demonstrates superior performance over all recent NeRF-based SLAM methods in terms of mapping and tracking accuracy on Replica and ScanNet datasets, while also showing excellent capabilities in accurate semantic segmentation and real-time semantic mapping.


title: Improving Adversarial Transferability by Stable Diffusion

abstract: Deep neural networks (DNNs) are susceptible to adversarial examples, which introduce imperceptible perturbations to benign samples, deceiving DNN predictions. While some attack methods excel in the white-box setting, they often struggle in the black-box scenario, particularly against models fortified with defense mechanisms. Various techniques have emerged to enhance the transferability of adversarial attacks for the black-box scenario. Among these, input transformation-based attacks have demonstrated their effectiveness. In this paper, we explore the potential of leveraging data generated by Stable Diffusion to boost adversarial transferability. This approach draws inspiration from recent research that harnessed synthetic data generated by Stable Diffusion to enhance model generalization. In particular, previous work has highlighted the correlation between the presence of both real and synthetic data and improved model generalization. Building upon this insight, we introduce a novel attack method called Stable Diffusion Attack Method (SDAM), which incorporates samples generated by Stable Diffusion to augment input images. Furthermore, we propose a fast variant of SDAM to reduce computational overhead while preserving high adversarial transferability. Our extensive experimental results demonstrate that our method outperforms state-of-the-art baselines by a substantial margin. Moreover, our approach is compatible with existing transfer-based attacks to further enhance adversarial transferability.


title: SORTAD: Self-Supervised Optimized Random Transformations for Anomaly Detection in Tabular Data

abstract: We consider a self-supervised approach to anomaly detection in tabular data. Random transformations are applied to the data, and then each transformation is identified based on its output. These predicted transformations are used to identify anomalies. In tabular data this approach faces many challenges that are related to the uncorrelated nature of the data. These challenges affect the transformations that should be used, as well as the use of their predictions. To this end, we propose SORTAD, a novel algorithm that is tailor-made to solve these challenges. SORTAD optimally chooses random transformations that help the classification process, and have a scoring function that is more sensitive to the changes in the transformations classification prediction encountered in tabular data. SORTAD achieved state-of-the-art results on multiple commonly used anomaly detection data sets, as well as in the overall results across all data sets tested.


title: Hyperbolic Space with Hierarchical Margin Boosts Fine-Grained Learning from Coarse Labels

abstract: Learning fine-grained embeddings from coarse labels is a challenging task due to limited label granularity supervision, i.e., lacking the detailed distinctions required for fine-grained tasks. The task becomes even more demanding when attempting few-shot fine-grained recognition, which holds practical significance in various applications. To address these challenges, we propose a novel method that embeds visual embeddings into a hyperbolic space and enhances their discriminative ability with a hierarchical cosine margins manner. Specifically, the hyperbolic space offers distinct advantages, including the ability to capture hierarchical relationships and increased expressive power, which favors modeling fine-grained objects. Based on the hyperbolic space, we further enforce relatively large/small similarity margins between coarse/fine classes, respectively, yielding the so-called hierarchical cosine margins manner. While enforcing similarity margins in the regular Euclidean space has become popular for deep embedding learning, applying it to the hyperbolic space is non-trivial and validating the benefit for coarse-to-fine generalization is valuable. Extensive experiments conducted on five benchmark datasets showcase the effectiveness of our proposed method, yielding state-of-the-art results surpassing competing methods.


title: Production of Protons and Light Nuclei in Au+Au Collisions at $\sqrt{s_{\mathrm{NN}}}$ = 3 GeV with the STAR Detector

abstract: We report the systematic measurement of protons and light nuclei production in Au+Au collisions at $\sqrt{s_{\mathrm{NN}}}$ = 3 GeV by the STAR experiment at the Relativistic Heavy Ion Collider (RHIC). The transverse momentum ($p_{T}$) spectra of protons ($p$), deuterons ($d$), tritons ($t$), $^{3}\mathrm{He}$, and $^{4}\mathrm{He}$ are measured from mid-rapidity to target rapidity for different collision centralities. We present the rapidity and centrality dependence of particle yields ($dN/dy$), average transverse momentum ($\langle p_{T}\rangle$), yield ratios ($d/p$, $t/p$,$^{3}\mathrm{He}/p$, $^{4}\mathrm{He}/p$), as well as the coalescence parameters ($B_2$, $B_3$). The 4$\pi$ yields for various particles are determined by utilizing the measured rapidity distributions, $dN/dy$. Furthermore, we present the energy, centrality, and rapidity dependence of the compound yield ratios ($N_{p} \times N_{t} / N_{d}^{2}$) and compare them with various model calculations. The physics implications of those results on the production mechanism of light nuclei and on QCD phase structure are discussed.


title: Secure Software Development: Issues and Challenges

abstract: In recent years, technology has advanced considerably with the introduction of many systems including advanced robotics, big data analytics, cloud computing, machine learning and many more. The opportunities to exploit the yet to come security that comes with these systems are going toe to toe with new releases of security protocols to combat this exploitation to provide a secure system. The digitization of our lives proves to solve our human problems as well as improve quality of life but because it is digitalized, information and technology could be misused for other malicious gains. Hackers aim to steal the data of innocent people to use it for other causes such as identity fraud, scams and many more. This issue can be corrected during the software development life cycle, integrating security across the development phases, and testing of the software is done early to reduce the number of vulnerabilities that might or might not heavily impact an organisation depending on the range of the attack. The goal of a secured system software is to prevent such exploitations from ever happening by conducting a system life cycle where through planning and testing is done to maximise security while maintaining functionality of the system. In this paper, we are going to discuss the recent trends in security for system development as well as our predictions and suggestions to improve the current security practices in this industry.


title: XY Traverse Stage for Automated Microscopy using Compliant Mechanism

abstract: This abstract provides an overview of research in precision engineering, with a focus on compliant mechanisms for XY stage positioning. The study explores existing methods, such as piezoelectric actuators and compliant mechanisms, as well as the work of renowned researchers in the field. It introduces two distinctive approaches for displacement reduction: topology optimization and flexure transmission mechanisms. The research aims to improve precision and reliability in automated microscopy and suggests a novel actuation procedure for the XY traversal stage using displacement reduction compliant mechanisms. Compliant mechanisms are essential in this application due to their unique attributes, including high precision, reduced mechanical complexity. These mechanisms play a crucial role in XY stage positioning for automated microscopy, where accuracy and reliability are of paramount importance. The study suggests potential future directions for validation, considering thermal effects, scalability, and decoupling challenges in XY stage applications, with the ultimate goal of advancing automated microscopy technology.


title: Ruin probabilities with investments in random environment: smoothness

abstract: The paper deals with the ruin problem of an insurance company investing its capital reserve in a risky asset with the price dynamics given by a conditional geometric Brownian motion whose parameters depend on a Markov process describing a random variations in the economic and financial environments. We prove smoothness of the ruin probability as a function of the initial capital and obtain for it an integro-differential equation.


title: Intrinsic Ergodicity, Generators and Symbolic Representations of Algebraic Group Actions

abstract: We construct natural symbolic representations of intrinsically ergodic, but not necessarily expansive, principal algebraic actions of countably infinite amenable groups and use these representations to find explicit generating partitions (up to null-sets) for such actions


title: Estimation of function's supports under arithmetic constraints

abstract: The well-known $|supp(f)||supp(\widehat{f}|\geq |G|$ inequality gives lower estimation of each supports. In the present paper we give upper estimation under arithmetic constrains. The main notion will be the additive energy which plays a central role in additive combinatorics. We prove an uncertainty inequality that shows a trade-off between the total changes of the indicator function of a subset $A\subseteq \mathbb F^n_2$ and the additive energy of $A$ and the Fourier spectrum.


title: Higher Topos Theory in Physics

abstract: A brief exposition of the point of higher topos theory in (mathematical) physics, commissioned for the Encyclopedia of Mathematical Physics 2nd ed.

categories: math-ph hep-th math.AT math.CT math.DG math.MP


title: On anti-quasi-Sasakian manifolds of maximal rank

abstract: We discuss the existence of invariant anti-quasi-Sasakian (aqS) structures of maximal rank on compact homogeneous Riemannian manifolds and on nilpotent Lie groups. In the former case we obtain a non-existence result, while in the latter case we provide a complete classification. We also show that every compact aqS manifold has nonvanishing second Betti number.


title: The non-equilibrium temperature beyond local equilibrium assumption

abstract: In this manuscript, we propose a non-equilibrium temperature by a temperature dependent Vlasov equation for the charge particles transport through a environmental reservoir. A new damping force and a inverse damping relaxation time are derived based on the Vlasov equation, which have obvious influence on the external force and the relaxation time of transport particles. The non-equilibrium temperature for the transport particles is defined by their distribution function out of equilibrium, which is different from the equilibrium temperature of reservoir. There exists heat transfer between the transport particles and the reservoir, because the whole transport particles are in non-equilibrium state. Finally, we illustrate them by an example of one-dimensional charge particles transport under an external electric field, the non-equilibrium temperature and damping force defined by us are shown numerically.


title: Geometric Data Augmentations to Mitigate Distribution Shifts in Pollen Classification from Microscopic Images

abstract: Distribution shifts are characterized by differences between the training and test data distributions. They can significantly reduce the accuracy of machine learning models deployed in real-world scenarios. This paper explores the distribution shift problem when classifying pollen grains from microscopic images collected in the wild with a low-cost camera sensor. We leverage the domain knowledge that geometric features are highly important for accurate pollen identification and introduce two novel geometric image augmentation techniques to significantly narrow the accuracy gap between the model performance on the train and test datasets. In particular, we show that Tenengrad and ImageToSketch filters are highly effective to balance the shape and texture information while leaving out unimportant details that may confuse the model. Extensive evaluations on various model architectures demonstrate a consistent improvement of the model generalization to field data of up to 14% achieved by the geometric augmentation techniques when compared to a wide range of standard image augmentations. The approach is validated through an ablation study using pollen hydration tests to recover the shape of dry pollen grains. The proposed geometric augmentations also receive the highest scores according to the affinity and diversity measures from the literature.


title: Data Center Audio/Video Intelligence on Device (DAVID) -- An Edge-AI Platform for Smart-Toys

abstract: An overview is given of the DAVID Smart-Toy platform, one of the first Edge AI platform designs to incorporate advanced low-power data processing by neural inference models co-located with the relevant image or audio sensors. There is also on-board capability for in-device text-to-speech generation. Two alternative embodiments are presented: a smart Teddy-bear, and a roving dog-like robot. The platform offers a speech-driven user interface and can observe and interpret user actions and facial expressions via its computer vision sensor node. A particular benefit of this design is that no personally identifiable information passes beyond the neural inference nodes thus providing inbuilt compliance with data protection regulations.


title: Having Difficulty Understanding Manuals? Automatically Converting User Manuals into Instructional Videos

abstract: While users tend to perceive instructional videos as an experience rather than a lesson with a set of instructions, instructional videos are more effective and appealing than textual user manuals and eliminate the ambiguity in text-based descriptions. However, most software vendors only offer document manuals that describe how to install and use their software, leading burden for non-professionals to comprehend the instructions. In this paper, we present a framework called M2V to generate instructional videos automatically based on the provided instructions and images in user manuals. M2V is a two-step framework. First, an action sequence is extracted from the given user manual via natural language processing and computer vision techniques. Second, M2V operates the software sequentially based on the extracted actions; meanwhile, the operation procedure is recorded into an instructional video. We evaluate the usability of automatically generated instructional videos via user studies and an online survey. The evaluation results show, with our toolkit, the generated instructional videos can better assist non-professional end users with the software operations. Moreover, more than 85% of survey participants prefer to use the instructional videos rather than the original user manuals.


title: Which came first, set theory or logic?

abstract: The construction of first-order logic and set theory gives rise to apparent circularities of mutual dependence, making it unclear which can act as a self-contained starting point in the foundation of mathematics. In this paper, we carry out a metatheoretic and finitistic development of a first-order logical system in which we define formal set theory (ZFC). We contend that the techniques employed in constructing this system offer a philosophically sound basis for introducing ZFC and proceeding with the conventional formal development of mathematics. Lastly, by examining the chronology of the aforementioned construction, we attempt to answer the titular question.


title: Accretion of the relativistic Vlasov gas onto a Kerr black hole

abstract: We study the accretion of relativistic Vlasov gas onto a Kerr black hole, regarding the particles as distributed throughout all the space, other than just in the equatorial plane. We solve the relativistic Liouville equation in the full $3+1$ dimensional framework of Kerr geometry. For the flow that is stationary and axial symmetric, we prove that the distribution function is independent of the conjugate coordinates. For an explicit distribution that can approximate to Maxwell-J\"{u}ttner distribution, we further calculate the particle current density, the stress energy momentum tensor and the unit accretion rates of mass, energy and angular momentum. The analytic results at large distance are shown to be consistent with the limits of the numerical ones computed at finite distance. Especially, we show that the unit mass accretion rate agrees with the Schwarzschild result in the case of low temperature limit. Furthermore, we find from the numerical results that the three unit accretion rates vary with the angle in Kerr metric and the accretion of Vlasov gas would slow down the Kerr black hole. The closer to the equator, the faster it slows down the black hole.


title: Almost complex structure on finite points from bidirected graphs

abstract: We show that there is an almost complex structure on a differential calculus on finite points coming from a bidirected finite graph without multiple edges or loops. We concentrate on a polygon as a concrete case. In particular, a `holomorphic structure on the exterior bundle' built from the polygon is studied. Also a positive Hochschild 2-cocycle on the vertex set of the polygon, albeit a trivial one, is shown to arise naturally from the almost complex structure.


title: Quantum and Reality

abstract: Formalizations of quantum information theory in category theory and type theory, for the design of verifiable quantum programming languages, need to express its two fundamental characteristics: (1) parameterized linearity and (2) metricity. The first is naturally addressed by dependent-linearly typed languages such as Proto-Quipper or, following our recent observations: Linear Homotopy Type Theory (LHoTT). The second point has received much attention (only) in the form of semantics in "dagger-categories", where operator adjoints are axiomatized but their specification to Hermitian adjoints still needs to be imposed by hand. We describe a natural emergence of Hermiticity which is rooted in principles of equivariant homotopy theory, lends itself to homotopically-typed languages and naturally connects to topological quantum states classified by twisted equivariant KR-theory. Namely, we observe that when the complex numbers are considered as a monoid internal to Z/2-equivariant real linear types, via complex conjugation, then (finite-dimensional) Hilbert spaces do become self-dual objects among internally-complex Real modules. The point is that this construction of Hermitian forms requires of the ambient linear type theory nothing further than a negative unit term of tensor unit type. We observe that just such a term is constructible in LHoTT, where it interprets as an element of the infinity-group of units of the sphere spectrum, tying the foundations of quantum theory to homotopy theory. We close by indicating how this allows for encoding (and verifying) the unitarity of quantum gates and of quantum channels in quantum languages embedded into LHoTT.

categories: quant-ph math-ph math.AT math.CT math.MP


title: Approximation theorems throughout Reverse Mathematics

abstract: Reverse Mathematics (RM for short) is a program in the foundations of mathematics where the aim is to find the minimal axioms needed to prove a given theorem of ordinary mathematics. Generally, the minimal axioms are equivalent to the theorem at hand, assuming a weak logical system called the base theory. Moreover, many (most?) theorems are either provable in the base theory or equivalent to one of four logical systems, together called the Big Five. For instance, the Weierstrass approximation theorem, i.e. that a continuous function can be approximated uniformly by a sequence of polynomials, has been classified in RM as being equivalent to weak Koenig's lemma, the second Big Five system. In this paper, we study approximation theorems for discontinuous functions via Bernstein polynomials from the literature. We obtain (many) equivalences between the latter and weak Koenig's lemma. We also show that slight variations of these approximation theorems fall far outside of the Big Five but fit in the recently developed RM of new 'big' systems, namely the uncountability of R, the enumeration principle for countable sets, the pigeon-hole principle for measure, and the Baire category theorem. In conclusion, one equivalence in second-order RM, namely for the Weierstrass approximation theorem, gives rise to many equivalences in higher-order RM, and we hope the case study in this paper can serve as a kind of template.


title: Capacity Maximization for FAS-assisted Multiple Access Channels

abstract: This paper investigates a multiuser millimeter-wave (mmWave) uplink system in which each user is equipped with a multi-antenna fluid antenna system (FAS) while the base station (BS) has multiple fixed-position antennas. Our primary objective is to maximize the system capacity by optimizing the transmit covariance matrices and the antenna position vectors of the users jointly. To gain deeper insights, we commence by deriving upper bounds and approximations for the maximum capacity. Then we delve into the capacity maximization problem. Beginning with the simple scenario of a single user equipped with a single-antenna FAS, we reveal that a closed-form optimal solution exists when there are only two propagation paths between the user and the BS. In the case where multiple propagation paths are present, a near-optimal solution can be obtained through a one-dimensional search method. Expanding our focus to multiuser cases, where users are equipped with either single- or multi-antenna FAS, we show that the original capacity maximization problems can be reformulated into distinct rank-one programmings. Then, we propose alternating optimization algorithms to deal with the transformed problems. Simulation results indicate that FAS can improve the capacity of the multiple access (MAC) system greatly, and the proposed algorithms outperform all the benchmarks.


title: New limits on the local Lorentz invariance violation of gravity in the Standard-Model Extension with pulsars

abstract: Lorentz Violation (LV) is posited as a possible relic effect of quantum gravity at low energy scales. The Standard-Model Extension provides an effective field-theoretic framework for examining possible deviations attributed to LV. With their high observational accuracy, pulsars serve as ideal laboratories for probing LV. In the presence of LV, both the spin precession of solitary pulsars and orbital dynamics of binary pulsars would undergo modifications. Observations of pulse profiles and times of arrival (TOAs) of pulses allow for an in-depth investigation of these effects, leading to the establishment of strict limits on LV coefficients. We revisit the project of limiting local LV with updated pulsar observations. We employ a new parameter estimation method and utilize state-of-the-art pulsar timing observation data and get new limits on 8 linear combinations of LV coefficients based on 25 tests from 12 different systems. Compared to previous limits from pulsars, precision has improved by a factor of two to three. Additionally, we explore prospects for further improvements from pulsars. Simulation results indicate that more observations of spin precession in solitary millisecond pulsars could significantly enhance the accuracy of spatial LV coefficients, potentially by three to four orders of magnitude. As observational data accumulate, pulsars are anticipated to increasingly contribute to the tests of LV.


title: Synthetic Data Generation for Bridging Sim2Real Gap in a Production Environment

abstract: Synthetic data is being used lately for training deep neural networks in computer vision applications such as object detection, object segmentation and 6D object pose estimation. Domain randomization hereby plays an important role in reducing the simulation to reality gap. However, this generalization might not be effective in specialized domains like a production environment involving complex assemblies. Either the individual parts, trained with synthetic images, are integrated in much larger assemblies making them indistinguishable from their counterparts and result in false positives or are partially occluded just enough to give rise to false negatives. Domain knowledge is vital in these cases and if conceived effectively while generating synthetic data, can show a considerable improvement in bridging the simulation to reality gap. This paper focuses on synthetic data generation procedures for parts and assemblies used in a production environment. The basic procedures for synthetic data generation and their various combinations are evaluated and compared on images captured in a production environment, where results show up to 15% improvement using combinations of basic procedures. Reducing the simulation to reality gap in this way can aid to utilize the true potential of robot assisted production using artificial intelligence.


title: Observation of a Topological Phase Transition in Random Coaxial Cable Structures with Chiral Symmetry

abstract: We report an experimental study of the disordered Su-Schrieffer-Heeger (SSH) model, implemented in a system of coaxial cables, whose radio frequency properties map on to the SSH Hamiltonian. By measuring multiple chains with random hopping terms, we demonstrate the presence of a topologically protected state, with frequency variation of less than 0.2% over the ensemble. Connecting the ends of the chains to form loops, we observe a topological phase transition, characterised by the closure of the band gap and the appearance of states which are delocalised, despite the strong disorder.


title: Channel Estimation for FAS-assisted Multiuser mmWave Systems

abstract: This letter investigates the challenge of channel estimation in a multiuser millimeter-wave (mmWave) time-division duplexing (TDD) system. In this system, the base station (BS) employs a multi-antenna uniform linear array (ULA), while each mobile user is equipped with a fluid antenna system (FAS). Accurate channel state information (CSI) plays a crucial role in the precise placement of antennas in FAS. Traditional channel estimation methods designed for fixed-antenna systems are inadequate due to the high dimensionality of FAS. To address this issue, we propose a low-sample-size sparse channel reconstruction (L3SCR) method, capitalizing on the sparse propagation paths characteristic of mmWave channels. In this approach, each fluid antenna only needs to switch and measure the channel at a few specific locations. By observing this reduced-dimensional data, we can effectively extract angular and gain information related to the sparse channel, enabling us to reconstruct the full CSI. Simulation results demonstrate that our proposed method allows us to obtain precise CSI with minimal hardware switching and pilot overhead. As a result, the system sum-rate approaches the upper bound achievable with perfect CSI.


title: A New Invariant of Lattice polytopes

abstract: The maximal degree of monomials belonging to the unique minimal system of monomial generators of the canonical module $\omega(K[{\mathcal P}])$ of the toric ring $K[{\mathcal P}]$ defined by a lattice polytope ${\mathcal P}$ will be studied. It is shown that if ${\mathcal P}$ possesses an interior lattice point, then the maximal degree is at most ${\rm dim} {\mathcal P} - 1$, and that this bound is the best possible in general.


title: Hadamard states for linearized gravity on spacetimes with compact Cauchy surfaces

abstract: We consider the quantization of linearized Einstein equations. We prove the existence of Hadamard states in the harmonic gauge on any Einstein spacetime with compact Cauchy surfaces.


title: Conditional central limit theorem for critical branching random walk

abstract: Consider a critical branching random walk on $\mathbb{R}$. Let $Z^{(n)}(A)$ be the number of individuals in the $n$-th generation located in $A\in \mathcal{B}(\mathbb{R})$ and $Z_{n}:=Z^{(n)}(\mathbb{R})$ denote the population of the $n$-th generation. We prove that, under some conditions, for all $x\in \mathbb{R}$, as $n\to \infty$, $$\mathcal{L}\left(\frac{Z^{(n)}(-\infty, \sqrt{n} x]}{n} ~\bigg |~ Z_{n}>0\right) \Longrightarrow\mathcal{L}\left(Y(x)\right),$$ where $\Rightarrow$ means weak convergence and $Y(x)$ is a random variable whose distribution is specified by its moments.


title: Orca 2: Teaching Small Language Models How to Reason

abstract: Orca 1 learns from rich signals, such as explanation traces, allowing it to outperform conventional instruction-tuned models on benchmarks like BigBench Hard and AGIEval. In Orca 2, we continue exploring how improved training signals can enhance smaller LMs' reasoning abilities. Research on training small LMs has often relied on imitation learning to replicate the output of more capable models. We contend that excessive emphasis on imitation may restrict the potential of smaller models. We seek to teach small LMs to employ different solution strategies for different tasks, potentially different from the one used by the larger model. For example, while larger models might provide a direct answer to a complex task, smaller models may not have the same capacity. In Orca 2, we teach the model various reasoning techniques (step-by-step, recall then generate, recall-reason-generate, direct answer, etc.). More crucially, we aim to help the model learn to determine the most effective solution strategy for each task. We evaluate Orca 2 using a comprehensive set of 15 diverse benchmarks (corresponding to approximately 100 tasks and over 36,000 unique prompts). Orca 2 significantly surpasses models of similar size and attains performance levels similar or better to those of models 5-10x larger, as assessed on complex tasks that test advanced reasoning abilities in zero-shot settings. make Orca 2 weights publicly available at aka.ms/orca-lm to support research on the development, evaluation, and alignment of smaller LMs


title: DenseNet and Support Vector Machine classifications of major depressive disorder using vertex-wise cortical features

abstract: Major depressive disorder (MDD) is a complex psychiatric disorder that affects the lives of hundreds of millions of individuals around the globe. Even today, researchers debate if morphological alterations in the brain are linked to MDD, likely due to the heterogeneity of this disorder. The application of deep learning tools to neuroimaging data, capable of capturing complex non-linear patterns, has the potential to provide diagnostic and predictive biomarkers for MDD. However, previous attempts to demarcate MDD patients and healthy controls (HC) based on segmented cortical features via linear machine learning approaches have reported low accuracies. In this study, we used globally representative data from the ENIGMA-MDD working group containing an extensive sample of people with MDD (N=2,772) and HC (N=4,240), which allows a comprehensive analysis with generalizable results. Based on the hypothesis that integration of vertex-wise cortical features can improve classification performance, we evaluated the classification of a DenseNet and a Support Vector Machine (SVM), with the expectation that the former would outperform the latter. As we analyzed a multi-site sample, we additionally applied the ComBat harmonization tool to remove potential nuisance effects of site. We found that both classifiers exhibited close to chance performance (balanced accuracy DenseNet: 51%; SVM: 53%), when estimated on unseen sites. Slightly higher classification performance (balanced accuracy DenseNet: 58%; SVM: 55%) was found when the cross-validation folds contained subjects from all sites, indicating site effect. In conclusion, the integration of vertex-wise morphometric features and the use of the non-linear classifier did not lead to the differentiability between MDD and HC. Our results support the notion that MDD classification on this combination of features and classifiers is unfeasible.


title: CLIPSwarm: Converting text into formations of robots

abstract: We present CLIPSwarm, an algorithm to generate robot swarm formations from natural language descriptions. CLIPSwarm receives an input text and finds the position of the robots to form a shape that corresponds to the given text. To do so, we implement a variation of the Montecarlo particle filter to obtain a matching formation iteratively. In every iteration, we generate a set of new formations and evaluate their Clip Similarity with the given text, selecting the best formations according to this metric. This metric is obtained using Clip, [1], an existing foundation model trained to encode images and texts into vectors within a common latent space. The comparison between these vectors determines how likely the given text describes the shapes. Our initial proof of concept shows the potential of this solution to generate robot swarm formations just from natural language descriptions and demonstrates a novel application of foundation models, such as CLIP, in the field of multi-robot systems. In this first approach, we create formations using a Convex-Hull approach. Next steps include more robust and generic representation and optimization steps in the process of obtaining a suitable swarm formation.


title: On the inverse scattering transform to the discrete Hirota equation with nonzero boundary conditions

abstract: Under investigation in this work is the robust inverse scattering transform of the discrete Hirota equation with nonzero boundary conditions, which is applied to solve simultaneously arbitrary-order poles on the branch points and spectral singularities. Using the inverse scattering transform method, we construct the Darboux transformation but not with the limit progress, which is more convenient than before. Several kinds of rational solutions are derived in detail. These solutions contain W-shape solitons, breathers, high-order rogue waves, and various interactions between solitons and breathers. Moreover, we analyze some remarkable characteristics of rational solutions through graphics. Our results are useful to explain the related nonlinear wave phenomena.


title: On Projective representations of direct product of groups

abstract: Let $G=G_1 \times G_2$ be a finite group. We know that the second cohomology group $H^2(G,\mathbb C^\times)$ is isomorphic to $H^2(G_1,\mathbb C^\times) \times H^2(G_2,\mathbb C^\times) \times Hom(G_1/G_1' \otimes_\mathbb Z G_2/G_2', \mathbb C^\times ).$ A $2$-cocycle $\alpha$ of $G$ is called a bilinear cocycle if the corresponding cohomology class $[\alpha]$ of $H^2(G,\mathbb C^\times)$ lies in $Hom(G_1/G_1' \otimes_\mathbb Z G_2/G_2', \mathbb C^\times)$. In this article, our aim is to construct an irreducible complex projective representation $\rho$ of $G$ for bilinear cocycles $\alpha$. If $G_1$ is any abelian $p$-group and $G_2$ is an elementary abelian $p$-group, then we give a construction of $\rho$ for bilinear cocycles $\alpha$ of $G$. For a subgroup $H$ of $G$ of index $\leq p^2$, we also count the number of cohomology classes $[\alpha]$ for which the irreducible projective representations behave the same while restricting on $H$. Finally, we consider any $p$-group $G=G_1\times G_2$, and we discuss how the above construction helps us to describe an irreducible $\alpha$-representation of $G$ when $[\alpha]$ is of order $p$ or $G_2/G_2'$ is elementary abelian. We also discuss several examples as an application of the above results.


title: Functional Neural Network Control Chart

abstract: In many Industry 4.0 data analytics applications, quality characteristic data acquired from manufacturing processes are better modeled as functions, often referred to as profiles. In practice, there are situations where a scalar quality characteristic, referred to also as the response, is influenced by one or more variables in the form of functional data, referred to as functional covariates. To adjust the monitoring of the scalar response by the effect of this additional information, a new profile monitoring strategy is proposed on the residuals obtained from the functional neural network, which is able to learn a possibly nonlinear relationship between the scalar response and the functional covariates. An extensive Monte Carlo simulation study is performed to assess the performance of the proposed method with respect to other control charts that appeared in the literature before. Finally, a case study in the railway industry is presented with the aim of monitoring the heating, ventilation and air conditioning systems installed onboard passenger trains.


title: An equivalent condition for abelian varieties over finite fields to have QM

abstract: In this paper, we give an equivalent condition for an abelian variety over a finite field to have multiplication by a quaternion algebra over a number field. We prove the result by combining Tate's classification of the endomorphism algebras of abelian varieties over finite fields with Yu's criterion of the existence of homomorphisms between semi-simple algebras.


title: Theorems on Transverse-Longitudinal Coupling-Based Bunch Compression and Harmonic Generation Schemes

abstract: In particle accelerators, transverse-longitudinal coupling (TLC) dynamics can be invoked for efficient bunch compression or high harmonic generation when one of the transverse eigenemittance is small. In this sense, complete or partial transverse-to-longitudinal emittance exchange in optical wavelength range is being actively studied, for example in free-electron lasers. Another example is the recent work on generalized longitudinal strong focusing steady-state microbunching, where TLC is exploited to take advantage of the ultrasmall vertical emittance in a planar electron storage ring to lower the modulation laser power for ultrashort microbunch generation on a turn-by-turn basis. For this kind of schemes, we have proved before three theorems, invoking 4D phase space dynamics, with their implications discussed. Here we generalize the analysis to 6D phase space dynamics. Various TLC-based beam manipulation scenarios, as listed in the references, are dictated by these theorems.


title: Effective graviton mass in de Sitter space

abstract: We calculate the effective mass of gravitational perturbations induced by the interaction of the classical gravitational field with quantum matter in the background of the Poincar\'e patch of de Sitter space. Using the Schwinger-Keldysh diagrammatic technique, the one-loop effective action is calculated and it is shown that the graviton does not acquire mass for the most symmetric Bunch-Davies state. However, we have shown that even in this case, there is a nontrivial modification of the theory at one loop in the scalar sector of gravity.


title: Modern extreme value statistics for Utopian extremes

abstract: Capturing the extremal behaviour of data often requires bespoke marginal and dependence models which are grounded in rigorous asymptotic theory, and hence provide reliable extrapolation into the upper tails of the data-generating distribution. We present a toolbox of four methodological frameworks, motivated by modern extreme value theory, that can be used to accurately estimate extreme exceedance probabilities or the corresponding level in either a univariate or multivariate setting. Our frameworks were used to facilitate the winning contribution of Team Yalla to the EVA (2023) Conference Data Challenge, which was organised for the 13$^\text{th}$ International Conference on Extreme Value Analysis. This competition comprised seven teams competing across four separate sub-challenges, with each requiring the modelling of data simulated from known, yet highly complex, statistical distributions, and extrapolation far beyond the range of the available samples in order to predict probabilities of extreme events. Data were constructed to be representative of real environmental data, sampled from the fantasy country of "Utopia"


title: Designing Interpretable ML System to Enhance Trust in Healthcare: A Systematic Review to Proposed Responsible Clinician-AI-Collaboration Framework

abstract: This paper explores the significant impact of AI-based medical devices, including wearables, telemedicine, large language models, and digital twins, on clinical decision support systems. It emphasizes the importance of producing outcomes that are not only accurate but also interpretable and understandable to clinicians, addressing the risk that lack of interpretability poses in terms of mistrust and reluctance to adopt these technologies in healthcare. The paper reviews interpretable AI processes, methods, applications, and the challenges of implementation in healthcare, focusing on quality control to facilitate responsible communication between AI systems and clinicians. It breaks down the interpretability process into data pre-processing, model selection, and post-processing, aiming to foster a comprehensive understanding of the crucial role of a robust interpretability approach in healthcare and to guide future research in this area. with insights for creating responsible clinician-AI tools for healthcare, as well as to offer a deeper understanding of the challenges they might face. Our research questions, eligibility criteria and primary goals were identified using Preferred Reporting Items for Systematic reviews and Meta-Analyses guideline and PICO method; PubMed, Scopus and Web of Science databases were systematically searched using sensitive and specific search strings. In the end, 52 publications were selected for data extraction which included 8 existing reviews and 44 related experimental studies. The paper offers general concepts of interpretable AI in healthcare and discuss three-levels interpretability process. Additionally, it provides a comprehensive discussion of evaluating robust interpretability AI in healthcare. Moreover, this survey introduces a step-by-step roadmap for implementing responsible AI in healthcare.


title: Choose Your Simulator Wisely: A Review on Open-source Simulators for Autonomous Driving

abstract: Simulators play a crucial role in autonomous driving, offering significant time, cost, and labor savings. Over the past few years, the number of simulators for autonomous driving has grown substantially. However, there is a growing concern about the validity of algorithms developed and evaluated in simulators, indicating a need for a thorough analysis of the development status of the simulators. To bridge the gap in research, this paper analyzes the evolution of simulators and explains how the functionalities and utilities have developed. Then, the existing simulators are categorized based on their task applicability, providing researchers with a taxonomy to swiftly assess a simulator's suitability for specific tasks. Recommendations for select simulators are presented, considering factors such as accessibility, maintenance status, and quality. Recognizing potential hazards in simulators that could impact the confidence of simulation experiments, the paper dedicates substantial effort to identifying and justifying critical issues in actively maintained open-source simulators. Moreover, the paper reviews potential solutions to address these issues, serving as a guide for enhancing the credibility of simulators.


title: Challenges in data-based geospatial modeling for environmental research and practice

abstract: With the rise of electronic data, particularly Earth observation data, data-based geospatial modelling using machine learning (ML) has gained popularity in environmental research. Accurate geospatial predictions are vital for domain research based on ecosystem monitoring and quality assessment and for policy-making and action planning, considering effective management of natural resources. The accuracy and computation speed of ML has generally proved efficient. However, many questions have yet to be addressed to obtain precise and reproducible results suitable for further use in both research and practice. A better understanding of the ML concepts applicable to geospatial problems enhances the development of data science tools providing transparent information crucial for making decisions on global challenges such as biosphere degradation and climate change. This survey reviews common nuances in geospatial modelling, such as imbalanced data, spatial autocorrelation, prediction errors, model generalisation, domain specificity, and uncertainty estimation. We provide an overview of techniques and popular programming tools to overcome or account for the challenges. We also discuss prospects for geospatial Artificial Intelligence in environmental applications.


title: Tactics2D: A Highly Modular and Extensible Simulator for Driving Decision-making

abstract: Simulation is a prospective method for generating diverse and realistic traffic scenarios to aid in the development of driving decision-making systems. However, existing simulators often fall short in diverse scenarios or interactive behavior models for traffic participants. This deficiency underscores the need for a flexible, reliable, user-friendly open-source simulator. Addressing this challenge, Tactics2D adopts a modular approach to traffic scenario construction, encompassing road elements, traffic regulations, behavior models, physics simulations for vehicles, and event detection mechanisms. By integrating numerous commonly utilized algorithms and configurations, Tactics2D empowers users to construct their driving scenarios effortlessly, just like assembling building blocks. Users can effectively evaluate the performance of driving decision-making models across various scenarios by leveraging both public datasets and user-collected real-world data. For access to the source code and community support, please visit the official GitHub page for Tactics2D at https://github.com/WoodOxen/Tactics2D.


title: HIDRO-VQA: High Dynamic Range Oracle for Video Quality Assessment

abstract: We introduce HIDRO-VQA, a no-reference (NR) video quality assessment model designed to provide precise quality evaluations of High Dynamic Range (HDR) videos. HDR videos exhibit a broader spectrum of luminance, detail, and color than Standard Dynamic Range (SDR) videos. As HDR content becomes increasingly popular, there is a growing demand for video quality assessment (VQA) algorithms that effectively address distortions unique to HDR content. To address this challenge, we propose a self-supervised contrastive fine-tuning approach to transfer quality-aware features from the SDR to the HDR domain, utilizing unlabeled HDR videos. Our findings demonstrate that self-supervised pre-trained neural networks on SDR content can be further fine-tuned in a self-supervised setting using limited unlabeled HDR videos to achieve state-of-the-art performance on the only publicly available VQA database for HDR content, the LIVE-HDR VQA database. Moreover, our algorithm can be extended to the Full Reference VQA setting, also achieving state-of-the-art performance. Our code is available publicly at https://github.com/avinabsaha/HIDRO-VQA.


title: AIMS-EREA -- A framework for AI-accelerated Innovation of Materials for Sustainability -- for Environmental Remediation and Energy Applications

abstract: Many environmental remediation and energy applications (conversion and storage) for sustainability need design and development of green novel materials. Discovery processes of such novel materials are time taking and cumbersome due to large number of possible combinations and permutations of materials structures. Often theoretical studies based on Density Functional Theory (DFT) and other theories, coupled with Simulations are conducted to narrow down sample space of candidate materials, before conducting laboratory-based synthesis and analytical process. With the emergence of artificial intelligence (AI), AI techniques are being tried in this process too to ease out simulation time and cost. However tremendous values of previously published research from various parts of the world are still left as labor-intensive manual effort and discretion of individual researcher and prone to human omissions. AIMS-EREA is our novel framework to blend best of breed of Material Science theory with power of Generative AI to give best impact and smooth and quickest discovery of material for sustainability. This also helps to eliminate the possibility of production of hazardous residues and bye-products of the reactions. AIMS-EREA uses all available resources -- Predictive and Analytical AI on large collection of chemical databases along with automated intelligent assimilation of deep materials knowledge from previously published research works through Generative AI. We demonstrate use of our own novel framework with an example, how this framework can be successfully applied to achieve desired success in development of thermoelectric material for waste heat conversion.


title: Analyzing Bridge Resonance and Lateral Vibrations Using String Vibration Principles

abstract: This article investigates the lateral vibration and resonance of bridges, crucial for transportation network integrity and traffic safety. It aims to understand the underlying principles and causes of these vibrations to enhance bridge design and maintenance. Utilizing Euler-Bernoulli beam theory and assumptions like linear elasticity and uniform material, the study simplifies complex bridge dynamics into a manageable model. It explores the bridge's flexural response under static and dynamic loads, focusing on resonance phenomena. Numerical simulations, including the finite difference method and analysis of nonlinear elastic responses, assess the bridge behavior under various load conditions, particularly periodic loads. The findings offer theoretical insights and practical guidelines for vibration control and safe bridge operation.


title: Bistability-assisted Mechanical Squeezing and Entanglement

abstract: We propose a scheme to squeeze mechanical motion and to entangle optical field with mechanical motion in an optomechanical system containing a parametric amplification. The scheme is based on optical bistability which emerges in the system for a strong enough driving field. By considering the steady state's lower branch of the bistability, the system shows weak entanglement and almost no mechanical squeezing. When the steady state is on the upper branch of the bistable shape, both squeezing and entanglement are greatly enhanced. Specifically, the entanglement shows three degrees of magnitude enhancement. However, this giant entanglement is fragile against decoherence and thermal fluctuation. Regarding the mechanical squeezing, it reaches the standard quantum limit (SQL) in the upper branch of the bistability. Our proposal provides a way to improve quantum effects in optomechanical systems by taking advantage of nonlinearities. This scheme can be realized in similar systems such as superconducting microwave, and hybrid optomechanical systems.


title: Hierarchical Cut Labelling -- Scaling Up Distance Queries on Road Networks

abstract: Answering the shortest-path distance between two arbitrary locations is a fundamental problem in road networks. Labelling-based solutions are the current state-of-the-arts to render fast response time, which can generally be categorised into hub-based labellings, highway-based labellings, and tree decomposition labellings. Hub-based and highway-based labellings exploit hierarchical structures of road networks with the aim to reduce labelling size for improving query efficiency. However, these solutions still result in large search spaces on distance labels at query time, particularly when road networks are large. Tree decomposition labellings leverage a hierarchy of vertices to reduce search spaces over distance labels at query time, but such a hierarchy is generated using tree decomposition techniques, which may yield very large labelling sizes and slow querying. In this paper, we propose a novel solution \emph{hierarchical cut 2-hop labelling (HC2L)} to address the drawbacks of the existing works. Our solution combines the benefits of hierarchical structures from both perspectives - reduce the size of a distance labelling at preprocessing time and further reduce the search space on a distance labelling at query time. At its core, we propose a new hierarchy, \emph{balanced tree hierarchy}, which enables a fast, efficient data structure to reduce the size of distance labelling and to select a very small subset of labels to compute the shortest-path distance at query time. To speed up the construction process of HC2L, we further propose a parallel variant of our method, namely HC2L$^p$. We have evaluated our solution on 10 large real-world road networks through extensive experiments.


title: On the number of zeros of $L-$functions attached to cusp forms of half-integral weight

abstract: Meher et al. [Proc. Amer. Math. Soc. 147 (2019)] have recently established that $L-$functions attached to certain cusp forms of half-integral weight have infinitely many zeros on the critical line. Kim [J. Numb. Th. 253 (2023)] obtained analogous results for $L-$functions attached to cusp forms twisted by an additive character $e\left(\frac{p}{q}n\right)$, $\frac{p}{q}\in\mathbb{Q}$. We extend the results of these authors by giving a lower bound for the number of such zeros. We start by developing a variant of a method of de la Val\'ee Poussin which seems to have interest as it avoids the evaluation of exponential sums. We finish the paper with an improvement of our first estimate by using Lekkerkerker's variant of the Hardy-Littlewood method.


title: Enhancing Transformer-Based Segmentation for Breast Cancer Diagnosis using Auto-Augmentation and Search Optimisation Techniques

abstract: Breast cancer remains a critical global health challenge, necessitating early and accurate detection for effective treatment. This paper introduces a methodology that combines automated image augmentation selection (RandAugment) with search optimisation strategies (Tree-based Parzen Estimator) to identify optimal values for the number of image augmentations and the magnitude of their associated augmentation parameters, leading to enhanced segmentation performance. We empirically validate our approach on breast cancer histology slides, focusing on the segmentation of cancer cells. A comparative analysis of state-of-the-art transformer-based segmentation models is conducted, including SegFormer, PoolFormer, and MaskFormer models, to establish a comprehensive baseline, before applying the augmentation methodology. Our results show that the proposed methodology leads to segmentation models that are more resilient to variations in histology slides whilst maintaining high levels of segmentation performance, and show improved segmentation of the tumour class when compared to previous research. Our best result after applying the augmentations is a Dice Score of 84.08 and an IoU score of 72.54 when segmenting the tumour class. The primary contribution of this paper is the development of a methodology that enhances segmentation performance while ensuring model robustness to data variances. This has significant implications for medical practitioners, enabling the development of more effective machine learning models for clinical applications to identify breast cancer cells from histology slides. Furthermore, the codebase accompanying this research will be released upon publication. This will facilitate further research and application development based on our methodology, thereby amplifying its impact.


title: Exotic Symmetry Breaking Properties of Self-Dual Fracton Spin Models

abstract: Fracton codes host unconventional topological states of matter and are promising for fault-tolerant quantum computation due to their large coding space and strong resilience against decoherence and noise. In this work, we investigate the ground-state properties and phase transitions of two prototypical self-dual fracton spin models -- the tetrahedral Ising model and the fractal Ising model -- which correspond to error-correction procedures for the representative fracton codes of type-I and type-II, the checkerboard code and the Haah's code, respectively, in the error-free limit. They are endowed with exotic symmetry-breaking properties that contrast sharply with the spontaneous breaking of global symmetries and deconfinement transition of gauge theories. To show these unconventional behaviors, which are associated with sub-dimensional symmetries, we construct and analyze the order parameters, correlators, and symmetry generators for both models. Notably, the tetrahedral Ising model acquires an extended semi-local ordering moment, while the fractal Ising model fits into a polynomial ring representation and leads to a fractal order parameter. Numerical studies combined with analytical tools show that both models experience a strong first-order phase transition with an anomalous $L^{-(D-1)}$ scaling, despite the fractal symmetry of the latter. Our work provides new understanding of sub-dimensional symmetry breaking and makes an important step for studying quantum-error-correction properties of the checkerboard and Haah's codes.


title: The Weighted HOM-Problem over Fields

abstract: The HOM-problem, which asks whether the image of a regular tree language under a tree homomorphism is again regular, is known to be decidable. Since then, weighted versions of this problem for different semirings have also been investigated. In this paper, we prove the weighted HOM-problem for all fields decidable, provided that the tree homomorphism is tetris-free (a condition that generalizes injectivity). To this end, we reduce the problem to a property of the device representing the homomorphic image in question; to prove this property decidable, we then derive a pumping lemma for such devices from the well-known pumping lemma for regular tree series over fields, proved by Berstel and Reutenauer in 1982.


title: Multi-block linearized alternating direction method for sparse fused Lasso modeling problems

abstract: In many statistical modeling problems, such as classification and regression, it is common to encounter sparse and blocky coefficients. Sparse fused Lasso is specifically designed to recover these sparse and blocky structured features, especially in cases where the design matrix has ultrahigh dimensions, meaning that the number of features significantly surpasses the number of samples. Quantile loss is a well-known robust loss function that is widely used in statistical modeling. In this paper, we propose a new sparse fused lasso classification model, and develop a unified multi-block linearized alternating direction method of multipliers algorithm that effectively selects sparse and blocky features for regression and classification. Our algorithm has been proven to converge with a derived linear convergence rate. Additionally, our algorithm has a significant advantage over existing methods for solving ultrahigh dimensional sparse fused Lasso regression and classification models due to its lower time complexity. Note that the algorithm can be easily extended to solve various existing fused Lasso models. Finally, we present numerical results for several synthetic and real-world examples, which demonstrate the robustness, scalability, and accuracy of the proposed classification model and algorithm


title: Demonstration of microwave single-shot quantum key distribution

abstract: Security of modern classical data encryption often relies on computationally hard problems, which can be trivialized with the advent of quantum computers. A potential remedy for this is quantum communication which takes advantage of the laws of quantum physics to provide secure exchange of information. Here, quantum key distribution (QKD) represents a powerful tool, allowing for unconditionally secure quantum communication between remote parties. At the same time, microwave quantum communication is set to play an important role in future quantum networks because of its natural frequency compatibility with superconducting quantum processors and modern near-distance communication standards. To this end, we present an experimental realization of a continuous-variable QKD protocol based on propagating displaced squeezed microwave states. We use superconducting parametric devices for generation and single-shot quadrature detection of these states. We demonstrate unconditional security in our experimental microwave QKD setting. We show that security performance can be improved by adding finite trusted noise to the preparation side. Our results indicate feasibility of secure microwave quantum communication with the currently available technology in both open-air (up to $\sim$ 80 m) and cryogenic (over 1000 m) conditions.


title: BeamSync: Over-The-Air Synchronization for Distributed Massive MIMO Systems

abstract: In distributed massive multiple-input multiple-output (MIMO) systems, multiple geographically separated access points (APs) communicate simultaneously with a user, leveraging the benefits of multi-antenna coherent MIMO processing and macro-diversity gains from the distributed setups. However, time and frequency synchronization of the multiple APs is crucial to achieve good performance and enable joint precoding. In this paper, we analyze the synchronization requirement among multiple APs from a reciprocity perspective, taking into account the multiplicative impairments caused by mismatches in radio frequency (RF) hardware. We demonstrate that a phase calibration of reciprocity-calibrated APs is sufficient for the joint coherent transmission of data to the user. To achieve synchronization, we propose a novel over-the-air synchronization protocol, named BeamSync, to calibrate the geographically separated APs without sending any measurements to the central processing unit (CPU) through fronthaul. We show that sending the synchronization signal in the dominant direction of the channel between APs is optimal. Additionally, we derive the optimal phase and frequency offset estimators. Simulation results indicate that the proposed BeamSync method enhances performance by 3 dB when the number of antennas at the APs is doubled. Moreover, the method performs well compared to traditional beamforming techniques.


title: SBTRec- A Transformer Framework for Personalized Tour Recommendation Problem with Sentiment Analysis

abstract: When traveling to an unfamiliar city for holidays, tourists often rely on guidebooks, travel websites, or recommendation systems to plan their daily itineraries and explore popular points of interest (POIs). However, these approaches may lack optimization in terms of time feasibility, localities, and user preferences. In this paper, we propose the SBTRec algorithm: a BERT-based Trajectory Recommendation with sentiment analysis, for recommending personalized sequences of POIs as itineraries. The key contributions of this work include analyzing users' check-ins and uploaded photos to understand the relationship between POI visits and distance. We introduce SBTRec, which encompasses sentiment analysis to improve recommendation accuracy by understanding users' preferences and satisfaction levels from reviews and comments about different POIs. Our proposed algorithms are evaluated against other sequence prediction methods using datasets from 8 cities. The results demonstrate that SBTRec achieves an average F1 score of 61.45%, outperforming baseline algorithms. The paper further discusses the flexibility of the SBTRec algorithm, its ability to adapt to different scenarios and cities without modification, and its potential for extension by incorporating additional information for more reliable predictions. Overall, SBTRec provides personalized and relevant POI recommendations, enhancing tourists' overall trip experiences. Future work includes fine-tuning personalized embeddings for users, with evaluation of users' comments on POIs,~to further enhance prediction accuracy.


title: A first-principles study of the electronic, vibrational, and optical properties of planar SiC quantum dots

abstract: With the reported synthesis of a fully planar 2D silicon carbide (SiC) allotrope, the possibilities of its technological applications are enormous. Recently, several authors have computationally studied the structures and electronic properties of a variety of novel infinite periodic SiC monolayers, in addition to the honeycomb one. In this work, we perform a systematic first-principles investigation of the geometry, electronic structure, vibrational, and optical absorption spectra of several finite, but, fully planar structures of SiC, i.e., 0D quantum dots (QDs). The sizes of the studied structures are in the 1.20--2.28 nm range, with their computed HOMO(H)-LUMO(L) gaps ranging from 0.66 eV to 4.09 eV, i.e., from the IR to the UV region of the spectrum. The H-L gaps in the SiC QDs are larger as compared to the band gaps of the corresponding monolayers, confirming the quantum confinement effects. In spite of covalent bonding in the QDs, Mulliken charge analysis reveals that Si atoms exhibit positive charges, whereas the C atoms acquire negative charges, due to the different electron affinities of the two atoms. Furthermore, a strong structure property relationship is observed with fingerprints both in the vibrational and optical spectra. The wide range of H-L gaps in different SiC QDs makes them well-suited for applications in fields such as photocatalysis, light-emitting diodes, and solar cells.